AI

4117 readers

8 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

How can I create an AI model from this dataset? (raw.githubusercontent.com)

submitted 5 months ago by kionite231@lemmy.ca to c/artificial_intel@lemmy.ml

11 comments fedilink hide all child comments

Hello,

I want to create an AI model to learn about AI/ML. so I have scraped some data from Threads and Instagram.now I am wondering how can I use this dataset to make an AI model or do something useful with it? (BTW I don't know anything about AI/ML. I have done internship as Data Analyst so I know a little bit about Linear regression etc. but don't know anything advance.)

I am really curious to explore this space :)

you are viewing a single comment's thread
view the rest of the comments

[–] andrew0@lemmy.dbzer0.com 3 points 5 months ago

Depending on how much compute you have available, you can look into finetuning models from HuggingFace (e.g. Llama 3, or a smaller Phi model). Look into LoRA, and try to learn how the model you choose calculates the loss.

There are various ways to train, and usually involves masking the input by replacing random input tokens with the mask token. I won't go into too much detail with this, because it's a lot to explain, and I suggest you read an article on this (link1 or link2)