<commit_before># Spark SFTP Connector Library

A library for constructing dataframes by downloading files from SFTP and writing dataframe to a SFTP server

## Requirements

This library requires Spark 2.x.

For Spark 1.x, please check [spark1.x](https://github.com/springml/spark-sftp/tree/spark1.x) branch.

## Linking
You can link against this library in your program at the following ways:

### Maven Dependency
```
<dependency>
	<groupId>com.springml</groupId>
	<artifactId>spark-sftp_2.11</artifactId>
	<version>1.1.0</version>
</dependency>

```

### SBT Dependency<commit_msg>Updated with Spark 2.0 changes<commit_after># Spark SFTP Connector Library

A library for constructing dataframes by downloading files from SFTP and writing dataframe to a SFTP server

## Requirements

This library requires Spark 2.x.

For Spark 1.x support, please check [spark1.x](https://github.com/springml/spark-sftp/tree/spark1.x) branch.

## Linking
You can link against this library in your program at the following ways:

### Maven Dependency
```
<dependency>
	<groupId>com.springml</groupId>
	<artifactId>spark-sftp_2.11</artifactId>
	<version>1.1.0</version>
</dependency>

```

### SBT Dependency
{'fraction_non_alphanumeric': 0.11167086481947942, 'fraction_numerical': 0.018471872376154493, 'mean_word_length': 4.930348258706467, 'pattern_counts': {'":': 0, '<': 19, '<?xml version=': 0, '>': 19, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2026134', 'n_tokens_mistral': 424, 'n_tokens_neox': 373, 'n_words': 120}