Java Code Examples for org.apache.hadoop.hive.serde2.typeinfo.MapTypeInfo#getMapKeyTypeInfo()
The following examples show how to use
org.apache.hadoop.hive.serde2.typeinfo.MapTypeInfo#getMapKeyTypeInfo() .
You can vote up the ones you like or vote down the ones you don't like,
and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example 1
Source File: MDSMapObjectInspector.java From multiple-dimension-spread with Apache License 2.0 | 6 votes |
public MDSMapObjectInspector( final MapTypeInfo typeInfo ){ TypeInfo keyTypeInfo = typeInfo.getMapKeyTypeInfo(); if( keyTypeInfo.getCategory() == ObjectInspector.Category.PRIMITIVE && ( (PrimitiveTypeInfo)keyTypeInfo ).getPrimitiveCategory() == PrimitiveCategory.STRING ){ keyObjectInspector = PrimitiveObjectInspectorFactory.javaStringObjectInspector; } else{ throw new RuntimeException( "Map key type is string only." ); } valueObjectInspector = MDSObjectInspectorFactory.craeteObjectInspectorFromTypeInfo( typeInfo.getMapValueTypeInfo() ); if( valueObjectInspector.getCategory() == ObjectInspector.Category.PRIMITIVE ){ getField = new PrimitiveGetField( (PrimitiveObjectInspector)valueObjectInspector ); } else if( valueObjectInspector.getCategory() == ObjectInspector.Category.UNION ){ getField = new UnionGetField( (UnionTypeInfo)( typeInfo.getMapValueTypeInfo() ) ); } else{ getField = new NestedGetField(); } }
Example 2
Source File: HiveBucketingV2.java From presto with Apache License 2.0 | 5 votes |
private static int hashOfMap(MapTypeInfo type, Block singleMapBlock) { TypeInfo keyTypeInfo = type.getMapKeyTypeInfo(); TypeInfo valueTypeInfo = type.getMapValueTypeInfo(); int result = 0; for (int i = 0; i < singleMapBlock.getPositionCount(); i += 2) { // Sic! we're hashing map keys with v2 but map values with v1 just as in // https://github.com/apache/hive/blob/7dc47faddba9f079bbe2698aaa4d8712e7654f87/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorUtils.java#L903-L904 result += hash(keyTypeInfo, singleMapBlock, i) ^ HiveBucketingV1.hash(valueTypeInfo, singleMapBlock, i + 1); } return result; }
Example 3
Source File: HiveBucketingV1.java From presto with Apache License 2.0 | 5 votes |
private static int hashOfMap(MapTypeInfo type, Block singleMapBlock) { TypeInfo keyTypeInfo = type.getMapKeyTypeInfo(); TypeInfo valueTypeInfo = type.getMapValueTypeInfo(); int result = 0; for (int i = 0; i < singleMapBlock.getPositionCount(); i += 2) { result += hash(keyTypeInfo, singleMapBlock, i) ^ hash(valueTypeInfo, singleMapBlock, i + 1); } return result; }