sparklyr.nested 0.0.4
- Replaced now-defunct dplyr::select_varscalls withtidyselect::vars_select
- Support (optionally) using listviewer::reactjsonto
view schemas
sparklyr.nested 0.0.3
- Initial release
- To support read schemas, array_type,binary_type,boolean_type,byte_type,character_type,date_type,double_type,float_type,integer_type,long_type,map_type,numeric_type,string_type,struct_field,struct_type, andtimestamp_typeare provided. These will return java
references needed for schema definition.
- sdf_selectenables access to nested fields (within
maps, structs, and arrays of structs).
- sdf_explodewill convert arrays of structs to simple
structs by duplicating rows over each unique array entry. Also works on
map types if- is_map=TRUE.
- sdf_nestand- sdf_unnestare similar to the
similarly named- tidyrfunctions.- sdf_unnestessentially chains- sdf_explodeand- sdf_selectwith some schema inspection.
- sdf_schema_jsonand- sdf_schema_viewersupport schema interrogation