Solr Sink () is used to save the processed data to Apache Solr .

Apache Solr is a search engine based on Apache Lucene that is used for:

• full-text search
• indexing data
• fast data retrieval
• search-based data analysis

Solr Sink is typically used when pipeline results need to be directly indexed into Solr so that they can:

• searched quickly
• used for dashboard
• used for search applications

Parameters of Solr Sink

1. Protocol
   Determines the type of communication protocol with the Solr server .
   Default:

       http
   

   Example configuration:

       Protocol = http
   

   If using a secure connection:

   Protocol = https
   

2. Host Name (IP)
   Specifies the Solr server address .
   It can be:
   • hostname
   • IP address
   Example:

       Host Name = solr-server.local
   

   or

       Host Name = 192.168.1.50 
   

3. Port Number
   Specifies the port used by the Solr service .
   Solr's default port is usually:

       8983
   

   Example configuration:

       Port Number = 8983   
   

4. Core
   Specifies the name of the Solr Core that will be used to store the data .
   In Solr, Core is a collection of indexes that store documents.
   Example:

       Core = transactions
   

   This means the data will be saved to:

       http://host:port/solr/transactions
   

5. Fields
   Specifies the Solr fields to be populated with data from the pipeline .
   This field must conform to the Solr schema .
6. Commit every
   Determines how many records are written before a commit is made to Solr .
   Commit is required for data:
   • permanently saved
   • available for search
   Example:

       Commit Every = 1000
   

   It means:
   • Every 1000 records , the system will commit to the Solr index .
   
   Large values → faster performance
   Small values → faster data appears in search
7. System Properties
   Used to set additional system configurations .
   Usually contains:
   • connection configuration
   • timeout
   • additional Solr parameters
   Example:

       solr.connection.timeout=10000,solr.socket.timeout=15000
   

   These parameters help regulate the performance and stability of the connection to Solr .

Supported Engines

Map Reduce	Spark 1.x RDD	Spark 2.x RDD	Spark 2.x Dataset	Apache Beam 2.29.0 Batch	Apache Beam 2.29.0 Streaming	Apache Flink 1.12.0 Batch	Apache Flink 1.12.0 Streaming	Apache Tez 0.9.1	PySpark