Starting from Spark 2 we can use option 'inferSchema' like this:getSparkSession().read().option("inferSchema", "true").csv("YOUR_CSV_PATH")
↧
Channel:
Spark-csv data source: infer data types - Stack Overflow
X
Are you the publisher?
Claim or
contact us
about this channel.
X
No ratings yet.
Channel Details:
- Title: Spark-csv data source: infer data types - Stack Overflow
- Channel Number: 78556466
- Language: English
- Registered On: March 13, 2024, 1:31 pm
- Number of Articles: 3
- Latest Snapshot: March 13, 2024, 1:32 pm
- RSS URL: https://stackoverflow.com/feeds/question/29725612
- Publisher: https://stackoverflow.com/q/29725612
- Description:
- Catalog: //infer56.rssing.com/catalog.php?indx=78556466
© 2025 //www.rssing.com