Question nw027 (csail_stata_neutron):
Provide information about publicly available subnets owned by tenant 9f13bf11e06e4d81b44c8c3e62d4362b.
The gold SQL never filters by subnet ownership. Its tenant predicate is entirely on NETWORKRBACS:
WHERE networkrbacs.action = 'access_as_shared'
AND (networkrbacs.target_tenant = '*'
OR networkrbacs.target_tenant = '9f13bf11e06e4d81b44c8c3e62d4362b')
i.e. it selects subnets on networks shared to the tenant (RBAC), not subnets the tenant owns. In the released data the distinction is total:
SUBNETS contains 0 of 49 rows with tenant_id = '9f13bf11…';
- gold's 3 result rows all have
subnets_tenant_id = '6f9adccbd03e4d2186756896957a14bf' — a different tenant.
So for the question as written the correct answer is the empty set. Either the gold should carry subnets.tenant_id = '9f13bf11…' (yielding ∅), or the question should say "available to tenant …" to match the query. (Since the corpus derives from real query logs, the SQL is presumably the ground truth of intent — in which case it's the NL phrasing that needs the fix.)
(Found while evaluating a query engine against the released fixtures; happy to provide anything further.)
Question nw027 (
csail_stata_neutron):The gold SQL never filters by subnet ownership. Its tenant predicate is entirely on
NETWORKRBACS:i.e. it selects subnets on networks shared to the tenant (RBAC), not subnets the tenant owns. In the released data the distinction is total:
SUBNETScontains 0 of 49 rows withtenant_id = '9f13bf11…';subnets_tenant_id = '6f9adccbd03e4d2186756896957a14bf'— a different tenant.So for the question as written the correct answer is the empty set. Either the gold should carry
subnets.tenant_id = '9f13bf11…'(yielding ∅), or the question should say "available to tenant …" to match the query. (Since the corpus derives from real query logs, the SQL is presumably the ground truth of intent — in which case it's the NL phrasing that needs the fix.)(Found while evaluating a query engine against the released fixtures; happy to provide anything further.)