Amazon Athena is a serverless interactive query service, it supports multiple formats for the data, there is no infrastructure to manage and you pay only for what you use, in this case what you query (~5$ for every TB of data queried – Oct 2019)
You can use Athena to run SQL queries on CSV files stored in S3. This video shows you how to do that.