Results by Product Category
Score % for each of the 13 product categories across all 16 experiment runs.
Each cell shows the percentage of maximum possible score for questions in that category.
Score % by Category
| Category |
Qs |
R1 |
R2 |
R3 |
R4 |
R5 |
R6 |
R7 |
R8 |
R9 |
R10 |
R11 |
R12 |
R13 |
R14 |
R15 |
R16 |
| Cortex AI Functions |
5 |
41.3% |
80.7% |
66.0% |
91.3% |
64.6% |
67.3% |
86.0% |
72.7% |
67.3% |
78.6% |
42.0% |
60.0% |
43.3% |
60.7% |
70.0% |
70.0% |
| Cortex Search (RAG) |
4 |
70.0% |
80.0% |
71.7% |
94.1% |
82.5% |
87.5% |
90.1% |
76.6% |
71.7% |
82.5% |
62.5% |
72.5% |
70.0% |
66.7% |
70.0% |
72.5% |
| Cortex Agents |
3 |
57.7% |
71.1% |
56.7% |
68.9% |
68.9% |
73.3% |
75.6% |
41.1% |
44.5% |
52.2% |
47.2% |
57.8% |
48.9% |
64.4% |
54.4% |
47.8% |
| Dynamic Tables |
5 |
69.3% |
91.3% |
79.4% |
96.7% |
84.0% |
67.4% |
94.7% |
73.3% |
77.3% |
74.7% |
62.0% |
63.3% |
74.3% |
69.0% |
75.3% |
74.7% |
| Snowpark |
5 |
49.3% |
58.0% |
74.7% |
99.3% |
61.3% |
56.7% |
95.4% |
76.0% |
78.0% |
79.3% |
58.7% |
61.7% |
76.7% |
76.3% |
75.3% |
76.0% |
| Streamlit in Snowflake |
4 |
76.6% |
74.2% |
70.9% |
88.3% |
75.0% |
65.0% |
96.7% |
79.2% |
72.5% |
81.7% |
57.9% |
73.3% |
72.5% |
61.6% |
78.4% |
75.0% |
| Apache Iceberg Tables |
5 |
67.4% |
63.4% |
72.1% |
96.7% |
62.0% |
70.0% |
95.4% |
72.0% |
65.3% |
69.3% |
55.3% |
58.0% |
66.7% |
53.3% |
65.7% |
67.0% |
| Snowflake ML |
5 |
51.3% |
83.3% |
70.7% |
90.0% |
74.6% |
76.7% |
91.4% |
68.0% |
60.0% |
66.0% |
46.0% |
44.0% |
58.7% |
62.0% |
63.3% |
66.7% |
| Snowpark Container Services |
4 |
67.5% |
63.3% |
76.7% |
100.0% |
70.9% |
86.7% |
98.4% |
79.2% |
75.0% |
74.2% |
68.3% |
68.3% |
69.2% |
76.2% |
70.0% |
74.2% |
| Native Apps Framework |
2 |
43.3% |
50.0% |
66.7% |
98.4% |
63.3% |
73.3% |
98.4% |
75.0% |
76.6% |
80.0% |
55.0% |
70.0% |
68.3% |
86.7% |
75.0% |
63.3% |
| Streams, Tasks, Snowpipe |
3 |
75.6% |
68.9% |
78.9% |
100.0% |
90.0% |
82.2% |
100.0% |
78.9% |
78.9% |
96.7% |
70.0% |
64.4% |
60.0% |
77.8% |
81.1% |
81.1% |
| Governance and Security |
2 |
73.4% |
78.3% |
73.4% |
96.6% |
80.0% |
56.7% |
98.4% |
76.6% |
71.7% |
85.0% |
61.7% |
68.3% |
82.5% |
71.7% |
66.7% |
75.0% |
| Architecture and Fundamentals |
3 |
54.4% |
48.8% |
76.7% |
97.8% |
54.4% |
61.1% |
95.6% |
78.9% |
78.9% |
76.7% |
62.2% |
54.5% |
71.1% |
66.7% |
76.7% |
78.9% |
Category Improvement: Baseline (Run 1) vs Best (Run 4)
| Category |
Baseline |
Best (R4) |
Delta |
| Cortex AI Functions |
41.3% |
91.3% |
+50.0pp |
| Cortex Search (RAG) |
70.0% |
94.1% |
+24.1pp |
| Cortex Agents |
57.7% |
68.9% |
+11.2pp |
| Dynamic Tables |
69.3% |
96.7% |
+27.4pp |
| Snowpark |
49.3% |
99.3% |
+50.0pp |
| Streamlit in Snowflake |
76.6% |
88.3% |
+11.7pp |
| Apache Iceberg Tables |
67.4% |
96.7% |
+29.3pp |
| Snowflake ML |
51.3% |
90.0% |
+38.7pp |
| Snowpark Container Services |
67.5% |
100.0% |
+32.5pp |
| Native Apps Framework |
43.3% |
98.4% |
+55.1pp |
| Streams, Tasks, Snowpipe |
75.6% |
100.0% |
+24.4pp |
| Governance and Security |
73.4% |
96.6% |
+23.2pp |
| Architecture and Fundamentals |
54.4% |
97.8% |
+43.4pp |
Must-Have Pass % by Category
| Category |
Qs |
R1 |
R2 |
R3 |
R4 |
R5 |
R6 |
R7 |
R8 |
R9 |
R10 |
R11 |
R12 |
R13 |
R14 |
R15 |
R16 |
| Cortex AI Functions |
5 |
35.0% |
85.0% |
80.0% |
85.0% |
35.0% |
30.0% |
75.0% |
93.4% |
83.4% |
90.0% |
36.7% |
56.6% |
21.6% |
53.3% |
80.0% |
85.0% |
| Cortex Search (RAG) |
4 |
81.2% |
75.0% |
93.8% |
93.8% |
81.2% |
87.5% |
93.8% |
97.9% |
93.8% |
93.8% |
79.2% |
89.6% |
79.1% |
93.8% |
89.6% |
95.8% |
| Cortex Agents |
3 |
58.3% |
66.7% |
91.7% |
66.7% |
41.7% |
41.7% |
75.0% |
61.1% |
72.2% |
66.7% |
36.1% |
50.0% |
33.3% |
33.3% |
72.2% |
52.8% |
| Dynamic Tables |
5 |
85.0% |
90.0% |
100.0% |
95.0% |
60.0% |
55.0% |
100.0% |
93.4% |
98.4% |
93.4% |
73.4% |
76.6% |
54.9% |
60.0% |
95.0% |
93.3% |
| Snowpark |
5 |
50.0% |
40.0% |
95.0% |
95.0% |
50.0% |
25.0% |
100.0% |
93.3% |
95.0% |
95.0% |
75.0% |
58.4% |
75.0% |
75.0% |
90.0% |
96.6% |
| Streamlit in Snowflake |
4 |
93.8% |
68.8% |
93.8% |
87.5% |
62.5% |
43.8% |
93.8% |
95.8% |
95.8% |
95.8% |
66.6% |
91.7% |
77.1% |
64.6% |
95.8% |
93.8% |
| Apache Iceberg Tables |
5 |
80.0% |
55.0% |
95.0% |
85.0% |
55.0% |
45.0% |
90.0% |
86.6% |
76.6% |
86.6% |
71.7% |
73.4% |
65.0% |
66.7% |
76.6% |
70.0% |
| Snowflake ML |
5 |
60.0% |
75.0% |
90.0% |
90.0% |
55.0% |
60.0% |
95.0% |
80.0% |
78.3% |
80.0% |
50.0% |
51.7% |
51.7% |
63.3% |
76.7% |
90.0% |
| Snowpark Container Services |
4 |
75.0% |
50.0% |
100.0% |
100.0% |
62.5% |
75.0% |
100.0% |
93.8% |
97.9% |
89.6% |
81.2% |
77.1% |
68.8% |
95.9% |
97.9% |
95.8% |
| Native Apps Framework |
2 |
37.5% |
50.0% |
87.5% |
100.0% |
37.5% |
37.5% |
100.0% |
100.0% |
100.0% |
100.0% |
58.2% |
87.5% |
79.1% |
79.1% |
100.0% |
79.1% |
| Streams, Tasks, Snowpipe |
3 |
100.0% |
66.7% |
100.0% |
100.0% |
91.7% |
75.0% |
100.0% |
100.0% |
97.2% |
100.0% |
80.6% |
66.7% |
69.5% |
66.7% |
100.0% |
100.0% |
| Governance and Security |
2 |
100.0% |
75.0% |
100.0% |
100.0% |
50.0% |
25.0% |
100.0% |
95.9% |
91.6% |
95.9% |
83.4% |
83.2% |
58.4% |
95.9% |
95.9% |
100.0% |
| Architecture and Fundamentals |
3 |
41.7% |
8.3% |
91.7% |
100.0% |
16.7% |
16.7% |
100.0% |
100.0% |
97.2% |
97.2% |
83.3% |
47.2% |
69.5% |
69.4% |
91.7% |
100.0% |