Skip to content
TheChatArchiveThe Chat Archive
Coherecommand-a-03-2025· CohereHugging Face LMArena Human Preference 140K

help me write a springboot spark service and controller, for an api post call /query…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Geminigemini-2.5-flash’s answer.
  1. User

    help me write a springboot spark service and controller, for an api post call /query that given the params - datasetPath, query, it will query and return the results. Consider spark session provided by the service for other methods already --- @Autowired public AnalyticsService(SparkSession sparkSession) { this.sparkSession = sparkSession; }---

  2. Cohere Assistant

    Below is an example of a Spring Boot application with a Spark service and controller to handle a POST request at the /query endpoint. The endpoint accepts datasetPath and query as parameters, executes the query on the specified dataset using Spark, and returns the results.

    1. Dependencies

    Ensure you have the necessary dependencies in your pom.xml for Spring Boot and Spark:

    <dependencies>
        <!-- Spring Boot Starter Web -->
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-web</artifactId>
        </dependency>
    
        <!-- Apache Spark SQL -->
        <dependency>
            <groupId>org.apache.spark</groupId>
            <artifactId>spark-sql_2.12</artifactId>
            <version>3.3.0</version>
        </dependency>
    
        <!-- Spring Boot Starter Parent (optional but recommended) -->
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-parent</artifactId>
            <version>2.7.5</version>
            <type>pom</type>
        </dependency>
    </dependencies>
    

    2. AnalyticsService

    This service handles the Spark logic.

    import org.apache.spark.sql.Dataset;
    import org.apache.spark.sql.Row;
    import org.apache.spark.sql.SparkSession;
    import org.springframework.beans.factory.annotation.Autowired;
    import org.springframework.stereotype.Service;
    
    import java.util.List;
    import java.util.stream.Collectors;
    
    @Service
    public class AnalyticsService {
    
        private final SparkSession sparkSession;
    
        @Autowired
        public AnalyticsService(SparkSession sparkSession) {
            this.sparkSession = sparkSession;
        }
    
        public List<String> queryDataset(String datasetPath, String query) {
            // Read the dataset from the given path
            Dataset<Row> dataset = sparkSession.read().format("parquet").load(datasetPath); // Adjust format as needed
    
            // Execute the SQL query
            Dataset<Row> result = sparkSession.sql(query);
    
            // Convert the result to a list of strings (e.g., JSON or CSV format)
            return result.toJSON().collectAsList().stream()
                    .map(json -> json.toString())
                    .collect(Collectors.toList());
        }
    }
    

    3. AnalyticsController

    This controller exposes the /query endpoint.

    import org.springframework.beans.factory.annotation.Autowired;
    import org.springframework.web.bind.annotation.PostMapping;
    import org.springframework.web.bind.annotation.RequestBody;
    import org.springframework.web.bind.annotation.RequestMapping;
    import org.springframework.web.bind.annotation.RestController;
    
    import java.util.List;
    
    @RestController
    @RequestMapping("/api")
    public class AnalyticsController {
    
        private final AnalyticsService analyticsService;
    
        @Autowired
        public AnalyticsController(AnalyticsService analyticsService) {
            this.analyticsService = analyticsService;
        }
    
        @PostMapping("/query")
        public List<String> queryDataset(@RequestBody QueryRequest request) {
            return analyticsService.queryDataset(request.getDatasetPath(), request.getQuery());
        }
    }
    

    4. QueryRequest

    A simple DTO to hold the request parameters.

    public class QueryRequest {
        private String datasetPath;
        private String query;
    
        // Getters and Setters
        public String getDatasetPath() {
            return datasetPath;
        }
    
        public void setDatasetPath(String datasetPath) {
            this.datasetPath = datasetPath;
        }
    
        public String getQuery() {
            return query;
        }
    
        public void setQuery(String query) {
            this.query = query;
        }
    }
    

    5. SparkSession Configuration

    Configure the SparkSession bean in a configuration class.

    import org.apache.spark.sql.SparkSession;
    import org.springframework.context.annotation.Bean;
    import org.springframework.context.annotation.Configuration;
    
    @Configuration
    public class SparkConfig {
    
        @Bean
        public SparkSession sparkSession() {
            return SparkSession.builder()
                    .appName("SpringBootSparkApp")
                    .master("local[*]") // Adjust as needed
                    .getOrCreate();
        }
    }
    

    6. Example Request

    Send a POST request to /api/query with the following JSON body:

    {
        "datasetPath": "hdfs://path/to/dataset",
        "query": "SELECT * FROM dataset WHERE column > 10"
    }
    

    7. Notes

    • Adjust the dataset format (parquet, csv, etc.) in the AnalyticsService based on your needs.
    • Handle exceptions and edge cases (e.g., invalid dataset path, malformed query) for production use.
    • Consider returning results in a more structured format (e.g., a list of maps or a custom DTO) instead of JSON strings.

    Let me know if you need further assistance!

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.