Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [project-planning]

17 questions
4
votes
2 answers

Tools for project management Data Science

I'm in charge of a small data science team (3 data scientists, me included). We do our projects with at least one business person (PM) per project ( we have 5 of these). We managed everything with meetings and emails, but as the number of projects…
Diogo Santos
  • 191
  • 1
  • 2
4
votes
1 answer

How to plan a model analysis that avoids overfitting?

Coming from statistics, I'm freshly trying to learn machine learning. I've read a lot of tutorials about ML, but have no real training. I'm working on a little project where my dataset have 6k lines and around 300 features. As I've read in my…
Dan Chaltiel
  • 341
  • 2
  • 10
2
votes
1 answer

What is the best practice for data folder structuring?

I work for a small data science consultancy firm and we are trying to standardize our project folder structure. We started from the cookiecutter structure which is a great base. However one of the discussion point lies in the subfolders of the data…
Technologic
  • 21
  • 1
2
votes
1 answer

General equation for getting an idea of the scale of a machine learning project

I'm writing an application for a project where we intend to teach a model to predict one aspect of an environment (traffic safety) using a database with 10 images (about 300x300px and, say, 256 colors) for each of either 100 000 or 15 million…
Henrik
  • 123
  • 3
2
votes
1 answer

Which are the strategies to counter the 80/20 dilema in Data Science projects?

Most of the time in Data Science projects is not spent in (performing) actual analytics but rather in other tasks, such as organizing data sources, collecting samples and preparing datasets, compiling and validating business rules in data, etc.This…
Gonzalo Garcia
  • 121
  • 3
2
votes
0 answers

Cameras for automatic customer service machine

For my university project, I am planning to build an automated customer service machine. One which recognizes when someone approaches the camera according to says hello, etc. Also, I am planning to add simple speech recognition and language…
Duke Glacia
  • 21
  • 1
2
votes
0 answers

Milestones of data science project

I'm looking at working on a machine learning project for a company, where they are interested in paying in instalments at certain milestones in the project. My initial thoughts are that how to define these milestones? It's development of a…
Tom
  • 141
  • 5
2
votes
2 answers

How do you avoid 'analysis paralysis' when choosing a method to implement?

When you have multiple methods to accomplish a task, how do you choose which one to implement?
DBinJP
  • 123
  • 2
1
vote
1 answer

Project structure - many projects share same large dataset

I have a bunch of projects for my job that are largely unrelated except they use the same data, which is pretty big on disk in csv format. I want these to exist separately from each other and I usually try to use the cookie cutter data science…
jesseWUT
  • 111
  • 2
1
vote
1 answer

Format for proposing a new algorithmic project?

I am working for an organization that is still new to implementing data science projects. I have an idea for a data spider/algorithm project that will require various pieces of code as well as datasets that I will need to gain access to. I know…
I_Play_With_Data
  • 2,129
  • 3
  • 17
  • 40
1
vote
0 answers

How Would You Approach This Project on Time Series and Anomaly Detection

TLDR Have background in MLOps and machine learning engineering, started at a new employer (as the first AI engineer) and failed in a project of time series forecasting. Approach detailed below, any idea on what could I do better? Original Task As…
Della
  • 345
  • 1
  • 3
  • 9
1
vote
1 answer

Create Period column based on a date column where the first month is 1, second 2, etc

I have a dataset with many project's monthly expendituries (cost curve), like this one: Project Date Expenditure(USD) Project A 12-2020 500 Project A 01-2021 1257 Project A 02-2021 125889 Project A 03-2021 102447 Project…
conradoov
  • 13
  • 3
0
votes
1 answer

General Process for new project

Often when i get a new project in machine learning the client always ask me either to do a particular task like a prediction for one thing or give me data and ask me to find what i can do with it. i've read the book hands-on machine learning with…
Fabieng
  • 13
  • 2
0
votes
0 answers

Project suggestions

I am an undergrad student, I have on campus internships coming up this July. I want to build some projects in the AI/ML domain, preferably in NLP or GenAI. Could anyone suggest some good ideas for projects they find interesting. Please don't write…
yoloboy_24
  • 11
  • 2
0
votes
2 answers

Data Science Project Data Workflow Structure

I'm in the middle of a project of marketing regarding the sales prediction with promotions. The client has very complex business processes and so the data needs a lot of preprocessing (joins, filters, etc.). I have organize the code in different…
ru.mp
  • 73
  • 1
  • 1
  • 7
1
2