Haystack Blog

Embeddings

Haystack 2.0

Vector Database

Tilde Thurium Senior Developer Advocate

Announcing the Astra DB Haystack Integration

Learn how to use the new Astra DB integrations for Haystack 2.0 in your RAG pipelines.

January 18, 2024

Learn how to use the Jina v2 Embedding models in a RAG pipeline with our new Haystack integration.

Community

Embeddings

Open Source

Integration

Tilde Thurium Senior Developer Advocate

Using Jina Embeddings v2 with Haystack 2.0 pipelines to summarize legal documents

Learn how to use the Jina v2 Embedding models in a RAG pipeline with our new Haystack integration.

January 10, 2024

A Year of Growth: Highlights from 2023 for Haystack and our Community

Open Source

Haystack 2.0

Community

Bilge Yucel Developer Advocate

Highlights of 2023

A Year of Growth: Highlights from 2023 for Haystack and our Community

January 5, 2024

Learn how to create a custom medical chatbot using PubMed and Mixtral 8x7B for keyword and answer generation

RAG

LLM

Haystack 2.0

Tilde Thurium Senior Developer Advocate

Building a Healthcare Chatbot with Mixtral 8x7b, Haystack, and PubMed

Learn how to create a custom medical chatbot using PubMed and Mixtral 8x7B for keyword and answer generation

January 2, 2024

Multi-Modal components and function calling with the new Gemini integrations for Haystack

RAG

Haystack 2.0

LLM

Tuana Celik Lead Developer Advocate

Tilde Thurium Senior Developer Advocate

Silvano Cerza Senior Software Engineer

Gemini Models with Google Vertex AI Integration for Haystack

Multi-Modal components and function calling with the new Gemini integrations for Haystack

December 18, 2023

Introducing the new Haystack Integration, allowing you to easily fine-tune and deploy models on the Gradient platform which you can use in Haystack pipelines

Open Source

Community

Haystack 2.0

Model Training

MLOps

LLM

Tuana Celik Lead Developer Advocate

Use Gradient Models with Haystack Pipelines

Introducing the new Haystack Integration, allowing you to easily fine-tune and deploy models on the Gradient platform which you can use in Haystack pipelines

December 11, 2023

Have a look into our first commitment to what will eventually become Haystack 2.0

Open Source

Community

Haystack 2.0

Tuana Celik Lead Developer Advocate

Massimiliano Pippi Core Engineering Lead

Introducing Haystack 2.0-Beta and Advent of Haystack

Have a look into our first commitment to what will eventually become Haystack 2.0

December 4, 2023

We evaluated different LLM-based approaches to text-to-SQL

LLM

SQL

RAG

Research

Michel Bartels NLP Engineer

Bijay Gurung Solution Engineer

Isabelle Nguyen Technical Content Writer

Using Generative AI to Query Large BI Tables: Our Findings

We evaluated different LLM-based approaches to text-to-SQL

November 29, 2023

Haystack 2.0

RAG

Sara Zanzottera Open Source Engineer

RAG Pipelines From Scratch

Let's build a simple RAG Pipeline with Haystack 2.0 by just connecting three components: a Retriever, a PromptBuilder and a Generator.

November 21, 2023

Build a RAG pipeline for multilingual hotel reviews using Cohere models and Haystack

Generative AI

Text Embeddings

Retrieval

Bilge Yucel Developer Advocate

Multilingual Generative Question Answering with Haystack and Cohere

Build a RAG pipeline for multilingual hotel reviews using Cohere models and Haystack

November 8, 2023

Haystack 2.0

LLM

Open Source

Stefano Fiorucci Open Source Engineer

Tuana Celik Lead Developer Advocate

Guide to Using Zephyr Models to Generate Answers on Your Data

Learn how to use the new Zephyr models in Haystack 2.0 pipelines with the upcoming HuggingFaceLocalGenerator

November 6, 2023

Take a look at how we are changing Haystack for advanced LLM pipelines, with an example that uses a custom component to fetch the latest Hacker News posts

RAG

Haystack 2.0

LLM

Tuana Celik Lead Developer Advocate

Customizing RAG Pipelines to Summarize Latest Hacker News Posts with Haystack 2.0 Preview

Take a look at how we are changing Haystack for advanced LLM pipelines, with an example that uses a custom component to fetch the latest Hacker News posts

September 22, 2023

Deployment

Generative AI

MLOps

Retrieval

Isabelle Nguyen Technical Content Writer

Kristof Herrmann Software Engineer

Deploying RAG to Production

How to go from a working prototype to a retrieval augmented generative AI system in production: an overview for data scientists

September 13, 2023

Use Whisper to provide YouTube videos as context for retrieval augmented generation

LLM

Generative AI

Retrieval

RAG

Tuana Celik Lead Developer Advocate

Talk to YouTube Videos with Haystack Pipelines

Use Whisper to provide YouTube videos as context for retrieval augmented generation

September 8, 2023

How to create a domain-focused Question and Answering (Q&A) system using Haystack's WebRetriever and RAG pipeline

LLM

NLP

Generative AI

Retrieval

Vladimir Blagojevic Senior Software Engineer

Talk to Haystack Docs: Creating a Domain-Focused Q&A RAG Pipeline with WebRetriever

How to create a domain-focused Question and Answering (Q&A) system using Haystack's WebRetriever and RAG pipeline

September 4, 2023

A guide to building a retrieval augmented generative pipeline for referenced documentation search.

LLM

Generative AI

Retrieval

Prompting

RAG

Tuana Celik Lead Developer Advocate

Generative Documentation Q&A with Weaviate and Haystack

A guide to building a retrieval augmented generative pipeline for referenced documentation search.

September 2, 2023

How the latest rankers optimize LLM context window utilization in Retrieval-Augmented Generation (RAG) pipelines

LLM

NLP

Generative AI

Retrieval

Vladimir Blagojevic Senior Software Engineer

Enhancing RAG Pipelines in Haystack: Introducing DiversityRanker and LostInTheMiddleRanker

How the latest rankers optimize LLM context window utilization in Retrieval-Augmented Generation (RAG) pipelines

August 29, 2023

Why use one retriever when you can have two?

Open Source

Retrieval

Text Embeddings

Isabelle Nguyen Technical Content Writer

Hybrid Document Retrieval

Why use one retriever when you can have two?

August 22, 2023

Details of the upcoming Haystack version and how you can give feedback

Community

Haystack 2.0

Bilge Yucel Developer Advocate

Shaping Haystack 2.0

Details of the upcoming Haystack version and how you can give feedback

August 14, 2023

How Airbus used Haystack to build a combined table and text QA system for pilots, aircraft maintenance workers, and others

Question Answering

Case Study

Isabelle Nguyen Technical Content Writer

Question Answering in the Cockpit

How Airbus used Haystack to build a combined table and text QA system for pilots, aircraft maintenance workers, and others

July 26, 2023

...and how we've implemented it in Haystack

Agent

LLM

Prompting

Isabelle Nguyen Technical Content Writer

Good Listener: How Memory Enables Conversational Agents

...and how we've implemented it in Haystack

July 7, 2023

A new tool to pull in prompts into your Haystack PromptNode, share them, and collaborate

Prompting

Community

Integration

Tuana Celik Lead Developer Advocate

Sara Zanzottera Open Source Engineer

Share and Use Prompts with PromptHub

A new tool to pull in prompts into your Haystack PromptNode, share them, and collaborate

June 29, 2023

An introduction to LLMs and how you can use them in your own applications with Haystack

LLM

Model Training

Isabelle Nguyen Technical Content Writer

What Is a Large Language Model (LLM)?

An introduction to LLMs and how you can use them in your own applications with Haystack

June 23, 2023

How to engineer your natural language prompts to get the best answers from a large language model

Prompting

LLM

Isabelle Nguyen Technical Content Writer

The Beginner's Guide to LLM Prompting

How to engineer your natural language prompts to get the best answers from a large language model

June 15, 2023

A guide to scale Haystack pipelines for production with Ray Serve

Integration

Deployment

MLOps

Massimiliano Pippi Core Engineering Lead

Run Haystack Pipelines in production with Ray Serve

A guide to scale Haystack pipelines for production with Ray Serve

June 14, 2023

LLM

NLP

Generative AI

Question Answering

Bilge Yucel Developer Advocate

Generative vs. Extractive Language Models

Which one is right for your use case?

May 22, 2023

Learn how to prevent prompt injections leveraging our new open-source model and dataset.

Prompting

LLM

Jasper Schwenzow Solution Engineer

How to Prevent Prompt Injections: An Incomplete Guide

Learn how to prevent prompt injections leveraging our new open-source model and dataset.

May 19, 2023

Enabling retrieval-augmented generative question answering with LLMs

MLOps

NLP

LLM

Python

Deployment

Kristof Herrmann Software Engineer

Scaling NLP indexing pipelines with KEDA and Haystack — Part 1: The Application

Enabling retrieval-augmented generative question answering with LLMs

May 1, 2023

MLOps

NLP

LLM

Python

Deployment

Kristof Herrmann Software Engineer

Scaling NLP indexing pipelines with KEDA and Haystack — Part 2: The Deployment

Enabling retrieval-augmented generative question answering with LLMs

May 1, 2023

Learn about QdrantDocumentStore, its advantages, and how to use it with Haystack.

Community

Vector Databases

Open Source

Integration

Bilge Yucel Developer Advocate

Kacper Lukawski Developer Advocate at Qdrant

New DocumentStore Integration for Haystack: QdrantDocumentStore

Learn about QdrantDocumentStore, its advantages, and how to use it with Haystack.

April 18, 2023

Python

Kristof Herrmann Software Engineer

Writing Professional Python Logs

Best Practices and Essential Tips for Effective Python Logging in Your Projects

April 13, 2023

LLMs can now make use of the right tools to resolve complex queries and tasks

LLM

Agent

Tuana Celik Lead Developer Advocate

Introducing Agents in Haystack: Make LLMs resolve complex tasks

LLMs can now make use of the right tools to resolve complex queries and tasks

March 30, 2023

Community

Bilge Yucel Developer Advocate

Announcing the Haystack Blog

A place for the community to learn more about Haystack, NLP, open source development and more!

March 3, 2023

Combine the power of large language models with a corpus of your choice to generate natural-sounding answers that are grounded in facts

LLM

NLP

GPT

Generative AI

Isabelle Nguyen Technical Content Writer

Build a Search Engine with GPT-3

Combine the power of large language models with a corpus of your choice to generate natural-sounding answers that are grounded in facts

January 31, 2023

The BERT language model greatly improved the standard for language models. This article explains BERT’s history and the language models derived from it.

NLP

Model Training

Tuana Celik Lead Developer Advocate

The Definitive Guide to BERT Models

The BERT language model greatly improved the standard for language models. This article explains BERT’s history and the language models derived from it.

January 16, 2023

Search your large collection of documents in the most effective way using open source tools

NLP

Semantic Search

Python

Tuana Celik Lead Developer Advocate

How to Build a Semantic Search Engine in Python

Search your large collection of documents in the most effective way using open source tools

November 23, 2022

You’ll almost never have to train a language model from scratch.

Model Training

Andrey A

When and How to Train Your Own Language Model

You’ll almost never have to train a language model from scratch.

August 3, 2022

What are they used for? Where can you find them? And what kind of information do they actually store?

NLP

Model Training

Tuana Celik Lead Developer Advocate

What is a Language Model?

What are they used for? Where can you find them? And what kind of information do they actually store?

July 20, 2022

A guide to the history and the role of text vectorization in semantic search systems

NLP

Text Embeddings

Vector Databases

Andrey A

What Is Text Vectorization? Everything You Need to Know

A guide to the history and the role of text vectorization in semantic search systems

December 3, 2021

All articles

Announcing the Astra DB Haystack Integration

Using Jina Embeddings v2 with Haystack 2.0 pipelines to summarize legal documents

Highlights of 2023

Building a Healthcare Chatbot with Mixtral 8x7b, Haystack, and PubMed

Gemini Models with Google Vertex AI Integration for Haystack

Use Gradient Models with Haystack Pipelines

Introducing Haystack 2.0-Beta and Advent of Haystack

Using Generative AI to Query Large BI Tables: Our Findings

RAG Pipelines From Scratch

Announcing the Astra DB Haystack Integration

Using Jina Embeddings v2 with Haystack 2.0 pipelines to summarize legal documents

Highlights of 2023

Building a Healthcare Chatbot with Mixtral 8x7b, Haystack, and PubMed

Gemini Models with Google Vertex AI Integration for Haystack

Use Gradient Models with Haystack Pipelines

Introducing Haystack 2.0-Beta and Advent of Haystack

Using Generative AI to Query Large BI Tables: Our Findings

RAG Pipelines From Scratch

Multilingual Generative Question Answering with Haystack and Cohere

Guide to Using Zephyr Models to Generate Answers on Your Data

Customizing RAG Pipelines to Summarize Latest Hacker News Posts with Haystack 2.0 Preview

Deploying RAG to Production

Talk to YouTube Videos with Haystack Pipelines

Talk to Haystack Docs: Creating a Domain-Focused Q&A RAG Pipeline with WebRetriever

Generative Documentation Q&A with Weaviate and Haystack

Enhancing RAG Pipelines in Haystack: Introducing DiversityRanker and LostInTheMiddleRanker

Hybrid Document Retrieval

Shaping Haystack 2.0

Question Answering in the Cockpit

Good Listener: How Memory Enables Conversational Agents

Share and Use Prompts with PromptHub

What Is a Large Language Model (LLM)?

The Beginner's Guide to LLM Prompting

Run Haystack Pipelines in production with Ray Serve

Generative vs. Extractive Language Models

How to Prevent Prompt Injections: An Incomplete Guide

Scaling NLP indexing pipelines with KEDA and Haystack — Part 1: The Application

Scaling NLP indexing pipelines with KEDA and Haystack — Part 2: The Deployment

New DocumentStore Integration for Haystack: QdrantDocumentStore

Writing Professional Python Logs

Introducing Agents in Haystack: Make LLMs resolve complex tasks

Announcing the Haystack Blog

Build a Search Engine with GPT-3

The Definitive Guide to BERT Models

How to Build a Semantic Search Engine in Python

When and How to Train Your Own Language Model

What is a Language Model?

What Is Text Vectorization? Everything You Need to Know

No articles found