Foundation Model

Also known as a "Base Model"

• Training: Trained on vast amounts of text data (websites, books, etc.) to learn general language patterns and information. 
• Capabilities: Good at general language understanding, but may not be effective at following specific instructions or performing specialized tasks without further training. 
• Example: A base model could be used as a starting point for developing a chatbot or a text summarization tool, but it would require fine-tuning to perform those tasks effectively.

Example foundation models:

• BERT (Language Model)
• GPT (Large Language Model)