Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [artificial-intelligence]

16 questions
4
votes
1 answer

Solve tough clustering problem with overlapping clusters

I'm having some trouble to solve a hard clustering problem. I have a 2D dataset characterized by non spherical and partially overlaping clusters with different densities. I've read a lot about clustering methods and for this type of data DBSCAN,…
Lorenço Santos
  • 41
  • 1
3
votes
0 answers

How can I link tasks using machine learning / ai based on historical task sequences?

I'm working on an AI model to predict dependency links between tasks for industrial plannifications, based on historical project data. I have two tables: Task Table (15 sheets, one sheet = one planning) ID activity Name of activity Equipment…
lili
  • 311
  • 6
2
votes
1 answer

What is appropriate Individual KPI for AI projects?

I work in the sales department of electronics component manufacturing company and we do data science projects using traditional algorithm like Random forests (success likelihood of design project), Time series (demamd forecasting), clustering (for…
The Great
  • 2,725
  • 3
  • 23
  • 49
2
votes
1 answer

How is openAI embedding models trained?

how it the embedding model trained? Are the embeddings simply extracted from chatGPT4 or are they trained differently from the beginning (pre-training stage)?
haneulkim
  • 479
  • 5
  • 17
2
votes
1 answer

How to download and fine tune a large language model locally?

I want to fine tune a model locally, not using HuggingFace or any other third party tool. Basically, I want: Download a trained model (Llama-2, Falcon, whatever is easiest). Fine-tune it locally with my own data (maybe a set of mathematical theorems…
user
  • 2,023
  • 7
  • 23
  • 38
1
vote
1 answer

Need support to straighten,crop image properly for requirement in computer vision

My requirement: Need to extract license plates without duplicates and store images in a folder,then apply ocr to extract text from images. What i have achieved: Iam able to detect license plates properly and with the help of tracking mechanism i was…
Raj
  • 11
  • 2
1
vote
0 answers

What are some tasks where AGI is always guaranteed to fail with non-zero probablility?

What are some cases where we can prove that AGI is always going to be wrong atleast some of the times? One case i can think of is any fact retrieval. For example, just retrieving the date of births of public figures, we know AGI is going to make…
Kutsit
  • 111
  • 2
1
vote
1 answer

Top_p parameter in langchain

I am trying to understand the top_p parameter in langchain (nucleus sampling) but I can't seem to grasp it. Based on this we sort the probabilities and select a subset that exceeds p and concurrently has the fewer members possible. For example…
Labyrinthian
  • 13
  • 2
1
vote
0 answers

Swin Transformer Relative Position Biases

I was reading the swin transformer paper and looking at the github implementation, i noticed that when calculating the relative position bias the input to the log function before the CPB MLP is scaled to a range 0 to 8. I couldn't see mention of…
jack
  • 11
  • 2
0
votes
0 answers

Data Scientist Trying to Learn Algorithms and Data Structures from "Introduction to Algorithms" book

I am reading the book "Introduction to Algorithms", 4th edition, by Thomas H. Corman, Charles E. Leiserson, Ronald L. Rivest and Clifford Stein to learn relevant knowledge related to algorithms and data structure for data science. I will add context…
MathPlease
  • 1
0
votes
0 answers

Custom NER Model

I have develop a custom NER model with custom labels,but whenever I am giving sentence that is out of training data it is giving either empty output or output with wrong label.Also,the model is not consistent and accurate most of the time.What…
Shashwat Singh
  • 1
0
votes
0 answers

Create model for manufacturing defect detection using python

Has anyone done some work on manufacturer defect detection? I need some input on this. I have done some research and found some examples like TensorFlow/Keras and CNN, but I need some real-time experience if someone has already explored it. Thanks…
Reetesh Nigam
  • 1
0
votes
0 answers

Improving performance of anomaly detection using dataset?

I am leveraging an isolation forest model from the scikit-learn library for anomaly detection in a time series dataset where each point in the dataset is a data frame. However, I possess additional knowledge about specific criteria that can identify…
SUNITA GUPTA
  • 111
  • 2
0
votes
1 answer

Can I run falcon-7b on a free google colab?

I'm a beginner at ML and AI. Background: I wanted to try out falcon-7b, the example I'm trying out: https://colab.research.google.com/drive/1BiQiw31DT7-cDp1-0ySXvvhzqomTdI-o?usp=sharing (Falcon-Guanaco example by hugging face team) . But I'm not…
hungryWolf
  • 103
  • 2
0
votes
2 answers

Where can I find the applied data science research papers?

I'm trying to find conferences that have applied data science papers published. I'm only interested in top ranked conferences. And I notice quite a number of them are quite theoretical, e.g. IJAI, NIPS, etc. Thanks
Student
  • 421
  • 2
  • 10
1
2