Support writing to Avro files

Introduces support for writing tables stored as Avro files. This supports writing all
data types except TIMESTAMP. Supports the following COMPRESSION_CODECs: NONE, DEFLATE,
SNAPPY.

Change-Id: Ica62063a4f172533c30dd1e8b0a11856da452467
Reviewed-on: http://gerrit.sjc.cloudera.com:8080/3863
Reviewed-by: Victor Bittorf <victor.bittorf@cloudera.com>
Tested-by: jenkins
(cherry picked from commit 15c6066d05d5077bee0d5123d26777b0715eb9c6)
Reviewed-on: http://gerrit.sjc.cloudera.com:8080/4056
This commit is contained in:
Victor Bittorf
2014-07-29 16:25:41 -07:00
committed by jenkins
parent 7d91391093
commit 820e1c070b
13 changed files with 489 additions and 14 deletions

View File

@@ -5,7 +5,7 @@ import pytest
from os.path import join
from subprocess import call
from tests.common.test_vector import *
from tests.common.impala_test_suite import ImpalaTestSuite
from tests.common.impala_test_suite import *
# (file extension, table suffix) pairs
compression_formats = [
@@ -110,6 +110,10 @@ class TestTableWriters(ImpalaTestSuite):
@classmethod
def add_test_dimensions(cls):
super(TestTableWriters, cls).add_test_dimensions()
cls.TestMatrix.add_dimension(create_single_exec_option_dimension())
def test_seq_writer(self, vector):
self.run_test_case('QueryTest/seq-writer', vector)
def test_avro_writer(self, vector):
self.run_test_case('QueryTest/avro-writer', vector)