Compressed CSV

CSV files are typically used as uncompressed files. However, compressing CSV files can be advantageous, especially for larger files, as it saves disk space and reduces transfer times. Depending on the system’s I/O performance, working with compressed CSV files can also speed up data processing.

Example

The following example demonstrates how to write and read CSV files with FastCSV using GZIP compression:

ExampleCsvCompression.java

package example;

import java.io.IOException;
import java.nio.file.Files;
import java.nio.file.Path;
import java.util.zip.GZIPInputStream;
import java.util.zip.GZIPOutputStream;

import de.siegmar.fastcsv.reader.CsvReader;
import de.siegmar.fastcsv.writer.CsvWriter;

/// Example for writing and reading compressed CSV data.
public class ExampleCsvCompression {

    public static void main(final String[] args) throws IOException {
        final Path file = Files.createTempFile("fastcsv", ".csv.gz");
        file.toFile().deleteOnExit();

        writeCsvGzipped(file);
        readCsvGzipped(file);
    }

    private static void writeCsvGzipped(final Path file) throws IOException {
        System.out.println("Writing compressed CSV file: " + file);

        try (
            var csv = CsvWriter.builder()
                .build(new GZIPOutputStream(Files.newOutputStream(file)))
        ) {
            csv.writeRecord("header1", "header2");
            csv.writeRecord("value1", "value2");
        }
    }

    private static void readCsvGzipped(final Path file) throws IOException {
        System.out.println("Reading compressed CSV file: " + file);

        try (
            var csv = CsvReader.builder()
                .ofCsvRecord(new GZIPInputStream(Files.newInputStream(file)))
        ) {
            csv.forEach(System.out::println);
        }
    }

}

You also find this source code example in the FastCSV GitHub repository.