Solr Source

Solr Source (

) eads indexed data from an Apache Solr server.
It supports parallel reading, field selection, and filter-based querying for efficient ingestion of search data into analytics or processing pipelines.

Apache Solr is a search engine based on Apache Lucene that is used for:

full-text search
indexing data
fast data retrieval
search-based data analysis

Parameters of Solr Source

Protocol
Determines the type of communication protocol with the Solr server .
Default:
```
    http
```
Example configuration:
```
    Protocol = http
```
If using a secure connection:
```
Protocol = https
```
Host Name (IP)
Specifies the Solr server address .
It can be:
- hostname
- IP address
Example:
```
    Host Name = solr-server.local
```
or
```
    Host Name = 192.168.1.50 
```
Port Number
Specifies the port used by the Solr service .
Solr's default port is usually:
```
    8983
```
Example configuration:
```
    Port Number = 8983   
```
Core
Specifies the name of the Solr Core that will be read/queried .
In Solr, Core is a collection of indexes that store documents.
Example:
```
    Core = transactions
```
This means the data will be read/queried from:
```
  http://host:port/solr/transactions
```
Fields
List of Solr fields to be read
If omitted, all fields are returned (depending on Solr configuration)
Filters
Solr filter query expression
Used to restrict results (e.g. by date, status, category, etc.)
Concurrent Read
Number of parallel worker readers
Controls the level of concurrency when fetching data from Solr
Rows Each Reader
Number of rows retrieved by each worker/reader
Total rows read = Concurrent Read × Rows Each Reader
System Properties
Additional Java system properties required by the Solr client
Defined as key–value pairs

Supported Engines

Map Reduce	Spark 1.x RDD	Spark 2.x RDD	Spark 2.x Dataset	Apache Beam 2.29.0 Batch	Apache Beam 2.29.0 Streaming	Apache Flink 1.12.0 Batch	Apache Flink 1.12.0 Streaming	Apache Tez 0.9.1	PySpark

Reference for securing solr Reference for securing solr