Description
Dig lets you access and modify property values in deeply nested, unstructured maps, using dot-separated paths:
Dig: plow through nested data with ease alternatives and similar packages
Based on the "Utilities" category.
Alternatively, view Dig: plow through nested data with ease alternatives based on common mentions on social networks and blogs.
-
fzf
:cherry_blossom: A command-line fuzzy finder -
delve
Delve is a debugger for the Go programming language. -
项目文档
基于vite+vue3+gin搭建的开发基础平台(支持TS,JS混用),集成jwt鉴权,权限管理,动态路由,显隐可控组件,分页封装,多点登录拦截,资源权限,上传下载,代码生成器,表单生成器,chatGPT自动查表等开发必备功能。 -
hub
A command-line tool that makes git easier to use with GitHub. -
excelize
Go language library for reading and writing Microsoft Excel™ (XLAM / XLSM / XLSX / XLTM / XLTX) spreadsheets -
go-torch
Stochastic flame graph profiler for Go programs. -
goreleaser
Deliver Go binaries as fast and easily as possible -
ctop
Top-like interface for container metrics -
GJSON
Get JSON values quickly - JSON parser for Go -
wuzz
Interactive cli tool for HTTP inspection -
resty
Simple HTTP and REST client library for Go -
Task
A task runner / simpler Make alternative written in Go -
usql
Universal command-line interface for SQL databases -
xlsx
(No longer maintained!) Go (golang) library for reading and writing XLSX files. -
godotenv
A Go port of Ruby's dotenv library (Loads environment variables from .env files) -
godropbox
Common libraries for writing Go services/applications. -
hystrix-go
Netflix's Hystrix latency and fault tolerance library, for Go -
go-funk
A modern Go utility library which provides helpers (map, find, contains, filter, ...) -
gorequest
GoRequest -- Simplified HTTP client ( inspired by nodejs SuperAgent ) -
Kopia
Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included. -
goreporter
A Golang tool that does static analysis, unit testing, code review and generate code quality report. -
panicparse
Crash your app in style (Golang) -
mc
Simple | Fast tool to manage MinIO clusters :cloud: -
gojson
Automatically generate Go (golang) struct definitions from example JSON -
lancet
A comprehensive, efficient, and reusable util function library of go. -
mergo
Mergo: merging Go structs and maps since 2013 -
create-go-app
✨ Create a new production-ready project with backend, frontend and deploy automation by running one CLI command! -
spinner
Go (golang) package with 90 configurable terminal spinner/progress indicators. -
grequests
A Go "clone" of the great and famous Requests library -
filetype
Fast, dependency-free Go package to infer binary file types based on the magic numbers header signature -
EaseProbe
A simple, standalone, and lightweight tool that can do health/status checking, written in Go. -
mole
CLI application to create ssh tunnels focused on resiliency and user experience. -
boilr
:zap: boilerplate template manager that generates files or directories from template repositories -
sling
A Go HTTP client library for creating and sending API requests -
beaver
💨 A real time messaging system to build a scalable in-app notifications, multiplayer games, chat apps in web and mobile apps. -
gitbatch
manage your git repositories in one place -
jump
Jump helps you navigate faster by learning your habits. ✌️ -
coop
Cheat sheet for some of the common concurrent flows in Go -
mimetype
A fast Golang library for media type and file extension detection, based on magic numbers -
go-underscore
Helpfully Functional Go - A useful collection of Go utilities. Designed for programmer happiness. -
circuitbreaker
Circuit Breakers in Go -
gentleman
Plugin-driven, extensible HTTP client toolkit for Go -
JobRunner
Framework for performing work asynchronously, outside of the request flow -
git-time-metric
Simple, seamless, lightweight time tracking for Git -
goreq
Minimal and simple request library for Go language.
Static code analysis for 29 languages.
Do you think we are missing an alternative of Dig: plow through nested data with ease or a related project?
README
Dig lets you access and modify property values in deeply nested, unstructured maps, using dot-separated paths:
source := make(map[string]interface{})
data := []byte(`{"a": "b", "c": {"a": "b"}}`)
json.Unmarshal(data, &source)
d := dig.NewMap(source)
log.Printf("%+v", s.Source())
// map[a:b c:map[a:b]]
s.SetValue("c.a", "42")
s.SetValue("a", "1000")
log.Printf("%+v", s.Source())
// map[a:1000 c:map[a:42]]
b, err := s.GetValue("c.a")
log.Println(b.(string))
// 42
NOTE: Still in development and mainly for educational purposes. Use with caution!
Why unstructured?
Most programming languages use (some sort of) structs for structured and maps for unstructured data. While structs are a great choice when one knows the layout of the incoming data, this may often not be the case. This is where generic maps hit the stage.
Motivation
One of the projects I worked on, was a data transformation pipeline that allowed users of the pipeline to send raw data to it, along with series of tiny rule mappings. Each rule mapping was a key-value pair, where both the key and the value would be tuples of the kind:
(nested.dotted.path.propertyToFilterUpon: filterValue), (nested.dotted.path.propertyToSetOrReplaceValueOf: newValue)
The first item of the tuple would be a dotted string, representing a nested path inside the data, e.g.:
location.address.postalCode
The value in each would be used to filter incoming data upon, or set the property under the given path, respectively. Key requirements for the pipeline were:
- agnostic to the data structure being passed to it
- resilient to change
- easy to configure (as in the example above), even by non-programmers
Advantages of dig
Upon creating a dig map, an index gets created under the hood, traversing each key until it reaches value, which cannot be traversed further (no maps, or slices). An index may look like this:
a -> val ptr,
a.b -> val.ptr
a.b.c -> val.ptr
a.b.d -> val.ptr
a.f -> val.ptr
// etc ...
Successing retrieval or value replacement with a nested path, is made using the index alone.
Creating the index is a slight overhead at the beginning, but it dramatically speeds up the look up of deeply nested paths, as it can be seen on the benchmark resutls below.
Performance Benchmarks
Listed below is the (after-index) performance of dig, when compared to manually traversing the path in a regular Go map. Lastly, GJSON - a popular JSON de/serialization library with similar capabilities gets thrown into the mix. As it can be seen, dig's reading speed is significantly higher.
Test ns. per operation
---
BenchmarkPerf/dig-8 29.1 ns/op
BenchmarkPerf/go-map-8 64.6 ns/op
BenchmarkPerf/gjson-8 201 ns/op