Ai4Users.comLocal AI & LLM community
Sign in to contributeSign in

Qwen 3.6 27B FP8 Thinking | Benchmark #84

Described in:Qwen 3.6 27B on FinQA: financial benchmark results and dataset fixes

Benchmark summary

Financial Reasoning Benchmark based on FinQA

ModelQwen 3.6 27B QuantizationFP8 ModeThinking

FinQA-based benchmark for numerical reasoning over financial reports, ported to the SC# evaluation runtime. Each test gives the model an excerpt from a company's annual report, with text and tables, and asks a question that needs the right figures and a correct calculation. During migration we checked every disputed task by hand: wrong FinQA reference answers were corrected and ambiguous questions were clarified.

Score 1098/1123 97.8% passed
1098 passed21 failed4 broken2 skipped1125 total 1123 AI queries 0 tool calls TOKENS IN2 508 270 TOKENS OUT1 807 530

Results by difficulty

3 groups
Level Medium
627 / 643 97.5%
passed
643 AI queries 0 tool calls IN1 440 972 OUT938 869
Level Hard
445 / 454 98.0%
passed
454 AI queries 0 tool calls IN1 015 826 OUT815 397
Level VeryHard
26 / 26 100.0%
passed
26 AI queries 0 tool calls IN51 472 OUT53 264

Results by category

2 groups
Category ContextProcessing
97.8% 1098/1123 passed
1123 AI queries 0 tool calls TOKENS IN2 508 270 TOKENS OUT1 807 530
Category Reasoning
97.8% 1098/1123 passed
1123 AI queries 0 tool calls TOKENS IN2 508 270 TOKENS OUT1 807 530

Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.

Benchmark items
Script / test Status Tokens
Reasoning - FinQA annual report calculations (set 1) 32 passed1 failed
97.0%
 IN73 839 OUT51 967
✓
FinQaAal2016FlightAttendantsMaintenancewhat is the ratio of the total flight attendants to total maintenance personnel1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 214 OUT1 335
✓
FinQaAapl2006GreatestProvisionIncomewhat was the greatest provision for income taxes , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 024 OUT856
✓
FinQaAdbe2008CombinedAccruedInterestthe combined amount of accrued interest and penalties related to tax positions taken on our tax returns and included in non-current income taxes payable was what percent of the total ending balance as of november 28 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 221 OUT3 306
✓
FinQaAdbe2008GrossLiabilityUnrecognizedwhat is the percentage change in the the gross liability for unrecognized tax benefits during 2008 compare to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 204 OUT1 634
✓
FinQaAdi2011CashFlowHedgeswhat is the percentage change in cash flow hedges in 2011 compare to the 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 423 OUT1 588
✓
FinQaAes2010RecourseDebtCurrentwhat percent of total recourse debt is current?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 107 OUT2 258
×
FinQaAlxn2016BorrowingUnderTermwhat is the borrowing under the term loan facility as a percentage of the total contractual maturities of long-term debt obligations due subsequent to december 31 , 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.6047, expected: 1.13599 Values: difference = 0.53129 tolerance = 0.011359900000000001
 Failed IN2 427 OUT4 018
✓
FinQaAmt2016QuarterEndedMarchfor the quarter ended march 312015 what was the percentage change in the share price from the highest to the lowest1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 046 OUT1 860
✓
FinQaAwk2014DeferredTaxAssetswhat was the percentage change in deferred tax assets and regulatory assets from 2013 to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 238 OUT1 543
✓
FinQaC2009NetInterestRevenuewhat percent of net interest revenue where total operating expenses in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 920 OUT1 390
✓
FinQaCmcsa2015UnrecognizedTaxBenefitswhat was the change in unrecognized tax benefits from the end of 2014 to the end of 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 285 OUT1 738
✓
FinQaDg2005ImpairmentCostsRecordedwhat was the total impairment costs recorded from 2003 to 2005 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 294 OUT2 275
✓
FinQaEtfc2007DecemberSquareFootageas of december 2007 what was the ratio of the square footage in alpharetta georgia to charlotte north carolina1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 303 OUT1 173
✓
FinQaEtr2016NetRevenueEntergywhat is the net change in net revenue during 2015 for entergy corporation?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 142 OUT1 247
✓
FinQaEtr2017NetRevenuewhat was the average net revenue between 2016 and 2017 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 711 OUT1 038
✓
FinQaFis2010PurchasePriceRelatedwhat portion of total purchase price is related to stock awards?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 954 OUT1 227
✓
FinQaFis2016CumulativeShareholderReturnwhat was the difference in percentage cumulative 5-year total shareholder return on common stock fidelity national information services , inc . compared to the s&p 500 for the period ending 12/16?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 697 OUT1 241
✓
FinQaGis2018NoncancelableFutureLeasewhat portion of the total noncancelable future lease commitments are due in fiscal year of 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 035 OUT1 324
✓
FinQaGpn2010IncomeTaxBenefitin 2010 what was the percent of the income tax benefit to the stock based compensation cost1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 177 OUT1 680
✓
FinQaGs2015FutureMinimumRentalwhat percentage of future minimum rental payments are due in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 280 OUT1 102
✓
FinQaIntc2015FacilitiesMeasuredSquarewhat percentage of total facilities as measured in square feet are leased?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 988 OUT864
✓
FinQaJkhy2019FiveReturnPeerwas the five year total return of the 2019 peer group greater than the 2018 peer group?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 043 OUT1 305
✓
FinQaJpm2010FairAssetsSegregatedin 2010 and 2009 , what was the total fair value in billions of assets segregated for the benefit of securities and futures brokerage customers?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 565 OUT2 041
✓
FinQaJpm2018CibMarketsNetin 2018 what was the percent of the cib markets net interest income as part of the managed interest income1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 683 OUT1 093
✓
FinQaMo2016AltriaOutperformdid altria outperform the s&p 500?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 080 OUT1 110
✓
FinQaMro2011NetAnnualDiscountedwhat was the average net annual change in discounted future net cash flows ( in millions ) for the years 2011 , 2010 , and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 773 OUT1 042
✓
FinQaPnc2012CommercialMortgageLoanswhat was the percentage change in the commercial mortgage loans designated for sale at fair value from 2008 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 523 OUT1 272
✓
FinQaPnc2012WouldFairSecuritieswhat would the fair value of total securities available for sale be without the fair value of securities classified as corporate stocks as of december 31 , 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 463 OUT1 498
✓
FinQaRcl2012AssumingEachContinentassuming each continent has the same number of destinations , approximately how many destinations does each continent have?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 358 OUT942
✓
FinQaStt2007GrowthBalanceStandbywhat is the growth rate in the balance of standby letters of credit from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 117 OUT1 596
✓
FinQaSyy2006RentalExpenseUnderwhat was the percentage change in total rental expense under operating leases from july 2 , 2005 to july 1 , 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 656 OUT2 417
✓
FinQaUaa2016DebtAssetwhat is the debt-to-asset ratio?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 684 OUT1 547
✓
FinQaUnp2015OperatingRevenuesAssociatedin 2015 what was the percent of the total operating revenues associated with agriculture products1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 204 OUT1 407
Reasoning - FinQA annual report calculations (set 10) 31 passed1 failed1 broken
93.9%
 IN73 866 OUT67 336
✓
FinQaAmt2008NetBalanceLiabilitywhat is the net change in the balance of liability related to employee separations during 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 446 OUT1 807
!
FinQaAwk2013DecemberInterestPenaltyas of december 31.2013 what was the ratio of the interest and penalty as a percent of the total unrecognized tax benefits1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
AI output broken (model loop aborted)
 Broken IN2 095 OUT18 577
✓
FinQaCb2008StatutoryCapitalSurplusin 2009 what was the ratio of the statutory capital and surplus to the statutory net income of the bermuda subsidiaries1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 328 OUT2 059
✓
FinQaCdw2015AntiDilutiveCommonif the anti-dilutive common shares were not excluded from the diluted weighted-average shares outstanding for the year ended december 31 , 2015 , what would the total diluted weighted-average shares outstanding be , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 283 OUT815
✓
FinQaCdw2017GrossMargin2what was 2016 gross margin percent?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 984 OUT1 317
✓
FinQaDvn2015VolatilityFactorwhat was the percent change in the volatility factor from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 192 OUT1 168
✓
FinQaEtfc2012Ottiwhat was the change in otti between 2011 and 2012 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 977 OUT1 813
✓
FinQaEtr2011EntergyCorporationSubsidiarieswhat was the percent of the change in the entergy corporation and subsidiaries net revenue in 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 874 OUT1 327
✓
FinQaFis2016CumulativeShareholderReturn2what was the percentage cumulative 5-year total shareholder return on common stock fidelity national information services , inc . for the period ending 12/16?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 686 OUT2 017
✓
FinQaFis2017IncreaseDecreaseWouldwhat percent of the total increase or decrease would the euro be in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 120 OUT683
×
FinQaGpn2010FairNonVested2what is the total fair value of non-vested shares as of may 31 , 2010 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 29946000, expected: 29946 Values: difference = 29916054 tolerance = 299.46
 Failed IN2 164 OUT2 807
✓
FinQaGrmn2006ConsideringPaymentsDueconsidering the payments due to less than a year , what is the percentage of purchase obligations concerning the total expenses?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 000 OUT1 629
✓
FinQaGs2013FiveReturnGoldmanwhat is the five year total return on the goldman sachs group inc.?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 886 OUT1 746
✓
FinQaGs2013NetEffectAdjustmentwhat is the net effect of adjustment from common shareholders 2019 equity to basel iii cet1?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 369 OUT1 358
✓
FinQaIp2009RentIncreasewhat was the percentage rent increase between 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 701 OUT1 157
✓
FinQaIpg2006InterestExpenseAvoidedwhat amount of interest expense was avoided per year by switching the 201c4.50% ( 201c4.50 % ) notes 201d with the 201c4.25% ( 201c4.25 % ) notes 201d?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 621 OUT2 072
✓
FinQaJpm2003FirmCommitmentsProvidewhat was the ratio of the firm commitments to provide liquidity on asset- specific basis in 2003 compared to 2002 $ 18.0 billion at december 31 , 2003 , and $ 23.5 billion at december 31 , 20021 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 819 OUT2 615
✓
FinQaJpm2008DecemberAuthorizedRepurchaseas of december 31 , 2008 , what percentage of authorized repurchase capacity remained under the current stock repurchase program ?:1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 654 OUT1 629
✓
FinQaLkq2016RentalExpenseOperatingwhat was the percentage change in rental expense for operating leases from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 891 OUT1 902
✓
FinQaMas2017CommonStockMascowhat was the ratio of the value of the common stock masco to s&p 500 index in 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 833 OUT565
✓
FinQaMmm2007RespiratorMaskAsbestoswhat is the ratio of the respirator mask/asbestos receivables to respirator mask/asbestos liabilities in 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 378 OUT1 544
✓
FinQaMro2017InitialHealthCarewhat was the average initial health care trend rate for the three year period in%?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 460 OUT1 924
✓
FinQaMs2013ConsumerRelatedLoansconsumer related loans make up how much of the companies total corporate lending exposure?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 058 OUT1 253
✓
FinQaPnc2012CommercialMortgageRecoursefor 2011 and 2012 , what were average commercial mortgage recourse obligations in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 369 OUT1 203
✓
FinQaRsg2009GrowthDividendYieldwhat was the percentage growth in the dividend yield from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 877 OUT1 688
✓
FinQaSlb2012WouldSharesOutstandingwhat would the 2012 shares outstanding in millions have been without the acquisition of smith international?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 721 OUT1 681
✓
FinQaSlg2011NumberSharesVestedwhat was the total number of shares vested during the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 446 OUT895
✓
FinQaSna2013AllowancesDoubtfulAccountsin 2013 what was the percent of the allowances for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 106 OUT1 432
✓
FinQaSyy2005PensionBenefitsPaidwhat is the percentage change in pension benefits to be paid between 2006 and 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 220 OUT2 199
✓
FinQaTfx2015RestructuringProgramsRelatedwhat portion of the total 2015 restructuring programs is related to termination benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 241 OUT1 029
✓
FinQaTmus2017SizeSquareFeetwhat is the average size ( in square feet ) of call centers in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 067 OUT1 200
✓
FinQaUps2016Buildingswhat was the change in millions of buildings from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 077 OUT620
✓
FinQaV2008SupportIncentivesExpectedwhat portion of the total support incentives is expected to be paid in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 923 OUT1 605
Reasoning - FinQA annual report calculations (set 11) 31 passed2 failed
93.9%
 IN70 168 OUT48 837
✓
FinQaAdbe2008YearlyAmortizationPurchasedwhat is the yearly amortization rate for the purchased technology?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 958 OUT690
✓
FinQaAes2001HighLowStockwhat was average of high and low stock prices for the first quarter of 2000?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 794 OUT829
✓
FinQaAmat2013ReturnInvestedAppliedwhat is the gain if $ 100000 is invested in applied materials in 2008 and sold in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 061 OUT1 372
✓
FinQaBll2006HardAssetsNetproperty , plant and equipment is what percent of net assets acquired for the u.s . can and alcan acquisitions combined?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 034 OUT867
✓
FinQaBll2010CashFlowsProvidedwhat was the percentage change in cash flows provided by ( used in ) operating activities including discontinued operations between 2009 and 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 168 OUT1 872
✓
FinQaC2009ContractualObligationsLongin 2010 what was the percent of the contractual obligations by year long-term debt obligations to the total1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 166 OUT810
✓
FinQaCdns2015CumulativeStockholderReturnwhat was the difference in percentage cumulative 5-year total stockholder return for cadence design systems inc . and the nasdaq copmosite for the period ended 1/3/2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 835 OUT1 252
✓
FinQaCe2009CurrencyMaturitiesWouldfor the 2010 currency maturities , what would the value be without the euro maturities , in us$ millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 182 OUT1 659
✓
FinQaDish2011CurrentBlockbusterPointwhat is the current ratio of blockbuster at the point of acquisition?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 021 OUT1 708
✓
FinQaDvn2012DebtMaturedwhat percentage of debt matured between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 913 OUT1 679
✓
FinQaEcl2017AssetsAcquiredAnioswhat portion of total assets acquired of anios are intangible assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 985 OUT1 836
✓
FinQaEcl2017CarryingGoodwillwhat is the percentage change in the total carrying amount of goodwill from 2015 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 463 OUT1 400
✓
FinQaEcl2017StatutoryEffectiveIncome2what is the difference between the statutory u.s . rate and the effective income tax rate in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 862 OUT1 715
✓
FinQaEtr2004DecreaseNetIncomewhat is the decrease in net income as a percentage of the the decrease in net revenue from 2003 to 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 825 OUT2 009
✓
FinQaEtr2004GrowthNetRevenue2what is the growth rate in net revenue in 2004 for entergy louisiana?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 815 OUT1 855
✓
FinQaEtr2017AnnualLongTermwhat is the percent change in annual long-term debt maturities from 2018 to 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 185 OUT1 188
×
FinQaFis2006LeasedLocationsLocatedwhat portion of the total leased locations are located in the united states ( count the number shown for grouped states as the number for each state listed )?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.7226, expected: 0.74448 Values: difference = 0.02188000000000001 tolerance = 0.0074448000000000005
 Failed IN1 911 OUT1 646
✓
FinQaFis2016ConsolidatedRevenuesGfswhat percent of total consolidated revenues in 2015 was the gfs segment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 994 OUT982
✓
FinQaGis2018NoncancelableFutureLease2what was the percent of the total noncancelable future lease commitments for operating leases that was due in 20201 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 037 OUT1 399
✓
FinQaGpn2013FairGrantedShareswhat is the total fair value of the granted shares in 2013 , ( in thousands ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 102 OUT1 968
✓
FinQaGs2013MinimumCollateralPostedin millions for 2013 and 2012 , what was the minimum collateral posted?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 173 OUT555
✓
FinQaGs2013SecuritiesCertainOvernightwhat percentage of total average securities and certain overnight cash deposits that are included in gce during 2013 were non-u.s . dollar-denominated?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 067 OUT1 630
✓
FinQaGs2018NetInterestIncomewhat was net interest income in the consolidated statements of earnings in billions for 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 535 OUT1 905
✓
FinQaGs2018NetRevenuesConsolidatedwhat is the total net revenues in the consolidated statements of earnings in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 534 OUT1 870
✓
FinQaHig2011IncreaseNetAsbestoswhat is the total increase in net asbestos reserves in 2010 and 2009 combined from unfavorable development driven by the same factors experienced by the direct policyholders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 222 OUT2 310
✓
FinQaHwm2018ConsideringExercisePrice2considering the average exercise price of options , what is the estimated total value of stock options in 2018 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 602 OUT580
✓
FinQaJpm2005EndedDecemberMidpointfor the year ended december 31 2005 , what was the midpoint earnings exposure between a 100bp and 200bp change in interest rates ( in us$ m ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 280 OUT1 537
✓
FinQaJpm2010DecemberCollateralAble2as of december 31 , 2009 , what percentage of the collateral that it was able to sell , repledge , deliver , or otherwise use was actually used for these purposes?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 946 OUT987
✓
FinQaJpm2015DerivativeReceivablesReportedwhat was the change in the derivative receivables reported on the consolidated balance sheets from 2014 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 476 OUT2 153
✓
FinQaLmt2014Backlogwhat was the change in millions in backlog at year-end between 2013 and 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 461 OUT1 098
✓
FinQaMro2004PeriodsPricePaidfor the periods 10/01/04 2013 10/31/04 and 11/01/04 2013 11/30/04 , what was the average of the average price paid per share?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 285 OUT1 244
✓
FinQaRsg2013ExpectedVolatilitywhat was the percentage change in the expected volatility from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 924 OUT1 782
×
FinQaSna2013IncomeTaxesPaidwhat is the difference between income taxes paid and income tax expense for 2013 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: actual != null Context: answer: Information not provided in the excerpt. Values: actual = null
 Failed IN2 352 OUT2 450
Reasoning - FinQA annual report calculations (set 12) 31 passed1 failed1 skipped
96.9%
 IN68 121 OUT43 428
✓
FinQaAmt2006NetBalanceEmployeewhat is the net change in the balance of employee separations liability during 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 471 OUT1 716
✓
FinQaAmt2006OutstandingNotesUnderwhat was the amount outstanding under the ati 7.25% ( 7.25 % ) notes in 2006 as a percent of the amount outstanding in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 226 OUT611
×
FinQaAmt2008WillBalanceAggregatewhat will be the balance of aggregate carrying value of long-term debt as of december 31 , 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 1837, expected: 4331309 Values: difference = 4329472 tolerance = 43313.090000000004
 Failed IN2 334 OUT1 419
✓
FinQaAmt2012FinalPurchasePricebased on the final purchase price allocation what was the sum of the liabilities1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 157 OUT947
✓
FinQaAmt2012ReclassificationOciIntowhat was the total reclassification of oci into income , in millions , during the years ended december 31 , 2012 , 2011 and 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 120 OUT2 234
✓
FinQaAon2007NetBalanceForeignwhat is the net change in the balance of net foreign exchange translation from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 476 OUT779
✓
FinQaAon2007PercentualIncreaseBalancewhat is the percentual increase in the balance during the year 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 690 OUT1 542
✓
FinQaAos2010CumulativeReturnSmithwhat was the difference in the cumulative total return for a o smith corp and the s&p small cap 600 index for the five year period ended 12/31/10?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 649 OUT1 902
✓
FinQaAwk2018PriceShareAwkat what price per share did awk repurchase its shares of common stock in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 702 OUT1 108
–
FinQaC2008ManagedConsumerLoanswhat was the percentage change in total managed consumer loans from 2007 to 2008?0 AI queries 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Skipped: Table header is garbled: the excerpt has two column groups both labelled 'end of period 2008/2007/2006' (the second group is likely average balances in the original PDF), so total managed consumer loans have two candidate values per year (e.g. 666.9 vs 618.3 for 2007); the model used each group in different runs. A human would need to ask which group is meant, and naming the figures would give the answer away.
 Skipped IN0 OUT0
✓
FinQaCdw2015MinimumForeignCurrencywhat was the minimum amount of foreign currency translation loss , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 117 OUT1 463
✓
FinQaDvn2018IncreaseExpensewhat is the percentage increase in total expense from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 805 OUT1 745
✓
FinQaGpn2008AmortizationExpenseRelatedwhat is the average amortization expense related to customer-related intangible assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 846 OUT2 005
✓
FinQaGpn2013FutureMinimumLeasewhat portion of the future minimum lease payments are due in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 897 OUT1 550
✓
FinQaHig2011NetReservesRelatedof the total net reserves , what portion is related to london market?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 207 OUT843
✓
FinQaHolx2009EstimatedFairHologicwhat is the estimated fair value per share of the hologic common stock issued in the cytyc merger?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 044 OUT1 735
✓
FinQaHolx2009EstimatedPurchasePricewhat portion of the total estimated purchase price is paid in cash?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 045 OUT1 240
✓
FinQaIlmn2008CompanyContributionsEmployeewhat was the change in millions of company contributions to the employee benefit plans retirement plan between 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 108 OUT1 084
✓
FinQaLmt2014WeightedCommonShareswhat was the change in millions of the weighted average common shares outstanding for diluted computations from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 219 OUT1 262
✓
FinQaMas2012DecemberOutstandingSharesas of december 2012 , what was the remaining repurchase authorization as a percent of the 50 million shares originally authorized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 963 OUT909
✓
FinQaMas2017GrowthIndexwhat was the percentage of the growth of the s&p 500 index from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 834 OUT1 317
✓
FinQaMo2014RestrictedStockDeferredwhat is the restricted stock and deferred stock vested in 2014 as a percentage of net earnings attributable to altria group inc . in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 909 OUT1 501
✓
FinQaMo2016AltriaOutperformPeerdid altria outperform it's peer group?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 077 OUT516
✓
FinQaMro2008PipelineBarrelsHandledwhat was total pipeline barrels handled ( thousands of barrels per day ) for the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 183 OUT1 456
✓
FinQaNclh2018CapitalExpenditureswhat is the anticipated percentage change in capital expenditures from 2019 to 2020?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 651 OUT1 384
✓
FinQaNws2017WillAmortizedEachhow much in millions will be amortized each year for the acquired technology related to the realtor.com ae website?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 020 OUT1 001
✓
FinQaPnc2012NonperformingLoansbetween 2011 an 2012 , what was the change in nonperforming loans in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 300 OUT1 296
✓
FinQaPnc2015PrincipleInterestProductsfor principle and interest products , what percent of the total was due in 2020 and thereafter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 533 OUT1 431
✓
FinQaSlg2011CompensationExpenseConnectionwhat was the percent of the change in the compensation expense in connection with connection with the 2005 outperformance plan.during from 2009 to 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 471 OUT1 345
✓
FinQaStt2006AssetsUnconsolidatedConduitswhat is the percentage change in total assets in unconsolidated conduits from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 435 OUT1 069
✓
FinQaTfx2015RestructuringProgramsRelated2what portion of the total 2015 restructuring programs is related to facility closer costs?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 242 OUT1 628
✓
FinQaUps2010ContractualObligationsCommitmentswhat percentage of contractual obligations and commitments in total are debt principal and debt interest?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 322 OUT2 134
✓
FinQaV2014ShareCompensationCostwhat is the total share-based compensation cost in the last three years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 068 OUT1 256
Reasoning - FinQA annual report calculations (set 13) 33 passed
100.0%
 IN75 143 OUT48 813
✓
FinQaAal2013BankruptcySettlementObligations2what portion of the total bankruptcy settlement obligations are related to labor deemed claims?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 449 OUT1 144
✓
FinQaAal2016FullTimeEmployees2what portion of the total full-time employees of mainline operations are pilots and flight crew instructors?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 219 OUT1 004
✓
FinQaAmt2012VivoAcquisitionAllowedfor the vivo acquisition what portion of the allowed towers were actually purchased under the final amended purchase agreement?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 167 OUT1 764
✓
FinQaAwk2013CompanyGrossLiabilitywhat is the he company 2019s gross liability at the end of 2013 if including interest and penalties?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 094 OUT647
✓
FinQaC2008IncreaseCitigroupAllowancewhat was the percentage increase in citigroup 2019s allowance for loan losses attributable to the consumer portfolio from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 944 OUT2 076
✓
FinQaCdns2015CumulativeStockholderReturn2what was the percentage cumulative 5-year total stockholder return for cadence design systems inc . for the period ended 1/3/2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 826 OUT1 400
✓
FinQaDg2009YearlyDepreciationLandwhat is the yearly depreciation rate for land improvements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 852 OUT862
✓
FinQaDg2010MinimumDepreciationCanwhat is the minimum depreciation rate that can be used for furniture fixtures and equipment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 827 OUT1 542
✓
FinQaDre2002GainLandSaleswhat is the percent change in gain on land sales from 2000 to 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 630 OUT1 157
✓
FinQaDxc2018CostsServiceswhat % ( % ) of total costs were the costs of services in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 332 OUT2 399
✓
FinQaEtr2011VarianceFavorablyAffectedwhat is the total amount of variance that favorably affected net revenue in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 872 OUT1 665
✓
FinQaEtr2013NuclearVolumeDecreasewhat is the nuclear volume as a percentage of the decrease in net revenue from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 951 OUT1 763
✓
FinQaGpn2013NetFairBalancewhat is the net change of the total fair value balance of non-vested shares during 2013 , in thousands of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 104 OUT2 843
✓
FinQaGpn2013UnrecognizedCompensationCostwhat was the average unrecognized compensation cost related to unvested restricted stock per year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 097 OUT1 536
✓
FinQaGs2015RelatingCommitmentsInvestin billions , what was the total for 2015 and 2014 relating to commitments to invest in funds managed by the firm?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 295 OUT1 329
✓
FinQaGs2017GreatestDerivativesin millions for 2017 and 2016 , what was the greatest amount of derivatives?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 119 OUT536
✓
FinQaGs2018MarketMakingRevenueswhat are the total market making revenues in the consolidated statements of earnings of 2017 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 538 OUT1 177
✓
FinQaHig2004NetIncomeCumulativewhat is the change in net income from cumulative effect of adoption?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 822 OUT1 158
✓
FinQaHii2015MinimumYearlyDepreciationwhat is the minimum yearly depreciation rate that can be used for land improvements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 037 OUT1 350
✓
FinQaHii2015NetIncomeMarginwhat is the net income margin in the q3 of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 858 OUT1 235
✓
FinQaHolx2006WouldCashImpactwhat would the cash impact be if all outstanding options warrants and rights were exercised?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 103 OUT2 078
✓
FinQaHum2009WeightedFairGrantwhat was the percent of the change of the weighted-average fair value at grant date from 2008 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 065 OUT1 580
✓
FinQaJpm2008ImpactDvaBasiswhat was the average impact on dva of a 1 basis point increase in jpmorgan chase credit spread for 2008 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 595 OUT1 092
✓
FinQaJpm2018CibMarketsNet2in 2017 what was the percent of the cib markets net interest income as part of the managed interest income1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 683 OUT1 339
✓
FinQaMo2014HigherPricingOperatingwhat is the higher pricing as a percentage of the operating companies income increase?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 926 OUT1 517
✓
FinQaMro2004DecreaseDevelopmentCostswhat was the 2004 rate of decrease in development costs?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 868 OUT2 795
✓
FinQaMro2007VestingDateFairwhat was the total vesting date fair value of restricted stock awards which vested during 2007 , 2006 and 2005 in $ million?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 604 OUT858
✓
FinQaMro2017InitialHealthCare2what is the difference in the initial health care trend rate and the ultimate health care trend rate in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 468 OUT1 685
✓
FinQaPnc2012HomeEquityUnresolved2for home equity unresolved asserted indemnification and repurchase claims in millions , what was average balance for december 31 2012 and december 31 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 962 OUT1 499
✓
FinQaSna2007PretaxLossesRelatedwhat was the percentage change in the in pretax losses related to foreign exchange transactions in 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 501 OUT1 937
✓
FinQaStt2011ApproximateNumberWorkforcewhat is the approximate total number of workforce before the restructuring program?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 205 OUT797
✓
FinQaUaa2016Inventorieswhat was the percentage change in inventories from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 696 OUT1 387
✓
FinQaUnp2009WillOperatingIncreaseswhat will the 2010 operating ratio be if the average of the 2009 and 2008 changes occurs in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 434 OUT1 662
Reasoning - FinQA annual report calculations (set 14) 32 passed1 failed
97.0%
 IN72 159 OUT47 590
✓
FinQaAapl2006TaxExpensewhat was the 2006 tax expense?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 023 OUT753
✓
FinQaAmat2018RoiAppliedMaterials2what is the roi for applied materials if the investment made on october 2013 was sold 5 years later?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 908 OUT1 098
✓
FinQaAmt2007SquareFootagePropertieswhat is the square footage of properties in massachusetts?\\n\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 994 OUT1 289
✓
FinQaAmt2016FebruaryCompanyMarketon february 17 , 2017 , what was the company's market capitalization as reported on the nyse.\\n\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 051 OUT3 131
✓
FinQaAon2018DeclineUncertainTaxin 2018 what was the percent of the decline in the uncertain tax positions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 150 OUT2 694
✓
FinQaApd2018DecreaseObservedFairwhat was the decrease observed in the total fair value of restricted stock that vested during 2017 and 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 016 OUT2 017
✓
FinQaAwk2014CompanyGrossLiabilityby how much did company 2019s gross liability , excluding interest and penalties , for unrecognized tax benefits increase from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 251 OUT1 428
✓
FinQaAwk2018IntangibleAssetAmortizationwhat is total intangible asset amortization expense ( millions ) for the years ended december 31 , 2018 , 2017 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 720 OUT1 451
✓
FinQaBlk2012LowerCarryingFairwhat percent lower is the carrying value than the fair value?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 427 OUT1 802
✓
FinQaBll2011ContractedBacklogDecemberthe contracted backlog at december 31 , 2011 contained how much in million dollars for fixed price contracts?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 276 OUT549
✓
FinQaCb2008AmortizationExpensewhat was the average amortization expense from 2006 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 321 OUT1 288
✓
FinQaCe2013GrowthDividendsReceivedwhat is the growth rate in dividends received in 2013 compare to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 263 OUT711
✓
FinQaDisca2014CumulativeShareholderReturn2what was the percentage cumulative total shareholder return on discb common stock for the five year period ended december 31 , 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 192 OUT1 242
✓
FinQaEtr2008RestrictedUnitsWillwhat portion of the total restricted units will vest in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 036 OUT911
✓
FinQaGpn2008NetAssetsAcquired3what portion of the net assets acquired is related to goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 843 OUT646
✓
FinQaGs2012MaximumNetDerivativein millions for 2012 2011 what was the maximum net derivative liabilities under bilateral agreements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 283 OUT1 098
✓
FinQaGs2013MaximumNetDerivativein millions for 2013 and 2012 , what was maximum net derivative liabilities under bilateral agreements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 176 OUT1 402
✓
FinQaGs2014GclaNonDollarin 2014 what percentage of gcla is in non-u.s . dollar denominated assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 066 OUT1 448
✓
FinQaGs2017LevelFinancialAssets2what was the change in level 3 financial assets from 2016 to 2017 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 121 OUT1 098
✓
FinQaGs2018NetRevenuesInvestmentwhat are the net revenues in investment management in 2016 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 561 OUT1 778
✓
FinQaHii2015NetIncomeMargin2what is the net income margin in the q1 of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 858 OUT1 283
✓
FinQaHum2017AmortizationExpenseOtherwhat was the ratio of the estimated amortization expense for other intangible assets in 2018 to 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 421 OUT851
✓
FinQaIp2009ContractualObligationsFuturewhat percentage of contractual obligations for future payments under existing debt and lease commitments and purchase obligations at december 31 , 2009 due in 2011 are maturities of long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 788 OUT2 223
✓
FinQaMrk2013GrowthSaleswhat is the growth rate in total sales in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 216 OUT1 256
✓
FinQaMro2008PipelineBarrelsHandled2what percentage of pipeline barrels handled consisted of crude oil trunk lines in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 183 OUT1 271
✓
FinQaMro2013NetUndevelopedAcreswhat percentage of net undeveloped acres expiring were located in the u.s in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 419 OUT1 471
✓
FinQaMsi2008DeclineOperatingLosswhat was the percentage decline in the operating loss from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 543 OUT2 221
✓
FinQaPnc2012ReserveLosseswhat was the average , in millions , reserve for losses in 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 363 OUT1 006
✓
FinQaRcl2012IncreasePortCostswhat was the percentage increase in port costs from 2010 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 359 OUT1 865
✓
FinQaSna2007SnapIncorporatedPeerin 2004 what was the ratio of the snap-on incorporated to the peer group perfomance1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 809 OUT850
×
FinQaStt2006UnrealizedLossForeignin 2006 , what percent of the unrealized loss on available-for-sale securities did foreign currency translation offset?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.4679, expected: 0.86784 Values: difference = 0.39993999999999996 tolerance = 0.0086784
 Failed IN2 426 OUT2 956
✓
FinQaUps2010ContractualObligationsCommitments2what percentage of contractual obligations and commitments in total are pension funding?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 319 OUT1 152
✓
FinQaZbh2009ContractualObligationsMade2what percentage of total contractual obligations is made up long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 777 OUT1 351
Reasoning - FinQA annual report calculations (set 15) 33 passed
100.0%
 IN71 145 OUT50 856
✓
FinQaAbmd2012AbiomedOutperformNasdaq2did abiomed outperform the nasdaq composite index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 745 OUT1 608
✓
FinQaAmt2003FollowingConsolidationBusinessin 2004 following the consolidation of the business operation what was the percentage of rental square feet in boston up for re-lease1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 975 OUT1 187
✓
FinQaAmt2003RedemptionNotesAccruedwhat fraction of the total redemption amount of the 6.25% ( 6.25 % ) notes was accrued interest?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 587 OUT1 622
✓
FinQaAmt2006AtiNotesPaidwhat portion of the ati 7.25% ( 7.25 % ) notes was paid off during 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 213 OUT1 783
✓
FinQaAmt2008OutstandingDebtUnderwhat is the percentage change in the the outstanding debt under the 3.00% ( 3.00 % ) notes from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 348 OUT1 565
✓
FinQaAmt2012SpentStockRepurchaseswas was the total amount spent on stock repurchases in december 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 968 OUT1 458
✓
FinQaAos2010CumulativeReturnSmith2what was the difference in the cumulative total return for a o smith corp and the russell 1000 index for the five year period ended 12/31/10?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 648 OUT1 880
✓
FinQaApd2016IncreaseOperatingMarginwhat is the increase in the operating margin observed in 2015 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 216 OUT1 777
✓
FinQaBll2006NetAssetsAcquiredwhat percentage of total net assets acquired were property plant and equipment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 021 OUT1 173
✓
FinQaC2009NetIncreaseSecuritieswhat was the ratio of the net increase in the in securities sold under agreements to repurchase to the net transfers in1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 935 OUT1 932
✓
FinQaD2002ContractsLongTermwhat percent of contracts for long-term purchases of capacity are due currently?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 774 OUT1 756
✓
FinQaDvn2018IncreaseExpense2what is the percentage increase in total expense from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 805 OUT1 255
✓
FinQaEmr2017PaceIssuanceRemainat the pace of 2017 how many years of issuance remain for the restricted stock plan for non-management directors?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 590 OUT2 590
✓
FinQaEtr2004DeferredFuelCostwhat was the reduction in net revenue from deferred fuel cost revisions as a percentage of 2004 net revenue?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 819 OUT1 447
✓
FinQaGs2013Assets2what was the change in millions of total assets from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 163 OUT1 672
✓
FinQaGs2013CumulativeReturnGoldman2what was the percentage cumulative total return for goldman sachs group inc . for the five year period ending 12/31/13?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 901 OUT773
✓
FinQaGs2014GclaNonDollar2in 2013 what percentage of gcla is in non-u.s . dollar denominated assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 066 OUT1 521
✓
FinQaGs2015FutureLeasePaymentsfor future lease payments , what percent was due in 2021 and thereafter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 282 OUT1 323
✓
FinQaHolx2009FairNonVested2what is the total fair value of non-vested shares as of september 27 , 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 177 OUT1 775
✓
FinQaHum2009ExpectedVolatilitywhat was the percent of the change of the expected volatility from 2008 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 060 OUT1 900
✓
FinQaIlmn2003CumulativeStockholderReturnwhat was the difference in cumulative total stockholder return percentage for illumina inc . common stock versus the nasdaq pharmaceutical index for the four years end 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 724 OUT1 729
✓
FinQaJpm2003DeclineCommercialPaperwhat was the decline in commercial paper issued by conduits during 2003 , in b?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 773 OUT1 745
✓
FinQaJpm2012LendingRelatedCommitmentswhat was the percentage change in lending-related commitments from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 300 OUT1 875
✓
FinQaMs2007NetAssetsAcquiredwhat percentage of net assets acquired is amortizable intangible assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 088 OUT856
✓
FinQaNke2009OutstandingDueNoteswhat percent of the total amount outstanding is due to notes payable due at mutually agreed-upon dates within one year of issuance or on demand?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 268 OUT1 280
✓
FinQaPkg2005PurchaseCommitmentsEnergywhat percentage of total purchase commitments for energy are currently in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 994 OUT807
✓
FinQaPpg2006IncreaseAssetRetirementwhat was the increase in asset retirement obligations for closure of assets in the chemicals manufacturing process in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 735 OUT1 633
✓
FinQaRsg2010AllowanceDoubtfulAccountsin 2008 what was the change in the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 096 OUT1 952
✓
FinQaRsg2010DecemberRestrictedCashas of december 31 , 2010 what was the ratio of the restricted cash and restricted marketable securities to the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 111 OUT1 628
✓
FinQaRsg2018DecemberTargetDebtbased on the december 31 2018 target what was the debt to equity ratio1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 950 OUT1 569
✓
FinQaSna2007RoiInvestmentMadewhat is the roi in s&p500 if the investment was made at the end of 2005 and sold at the end of 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 823 OUT1 662
✓
FinQaTmus2017OfficeSpaceThroughoutwhat is the ratio of the office space throughout the us to the office space for the corporate headquarters in bellevue1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 070 OUT1 331
✓
FinQaV2008ExpectedPaidSupportwhat amount is expected to be paid for support incentives in the next three years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 920 OUT792
Reasoning - FinQA annual report calculations (set 16) 32 passed1 skipped
100.0%
 IN71 979 OUT51 534
✓
FinQaAal2013EffectHedgesAnticipatedby what percentage do the hedges reduce the anticipated increase in 2014 annual fuel expense from a $ 1 per barrel increase in the price of crude oil?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 542 OUT2 040
✓
FinQaAbmd2008MaximumJuneContingentif the approximately $ 1.8 million of contingent payments that must be made in cash were all applied to the june 2008 impella contingent payment of $ 5.6 million , what percent of that payment would be in cash?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 360 OUT1 240
✓
FinQaAdbe2008WeightedUsefulLife2is the weighted average useful life ( years ) for trademarks greater than customer contracts and relationships?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 964 OUT279
✓
FinQaAes2010RecourseDebtDecemberwhat percentage of recourse debt as of december 31 , 2010 matures in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 123 OUT935
✓
FinQaAmt2005WriteOffConstructionwhat was the average write-off of construction-in-progress impairment charges from 2003 to 2005 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 480 OUT2 137
✓
FinQaAon2015SharePriceShareswhat was the compensation expense per share issued to u.s . employees under the employee share purchase plan in 2015 , in dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 095 OUT2 201
✓
FinQaBkng2016GrowthMeasurementPricelinewhat was the percent of the growth in measurement of the the priceline group inc . from 2014 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 556 OUT972
✓
FinQaBkr2017CashOperatingActivitieswhat is the cash from operating activities in 2017 as a percentage of cash and equivalents in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 270 OUT2 101
✓
FinQaBll2010NetSalesDiscontinuedwhat was the percentage change in net sales for the discontinued operations between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 318 OUT1 907
–
FinQaC2008ManagedConsumerLoans2what was the percentage change in total managed consumer loans from 2006 to 2007?0 AI queries 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Skipped: Table header is garbled: the excerpt has two column groups both labelled 'end of period 2008/2007/2006' (the second group is likely average balances in the original PDF), so total managed consumer loans have two candidate values per year (e.g. 666.9 vs 618.3 for 2007); the model used each group in different runs. A human would need to ask which group is meant, and naming the figures would give the answer away.
 Skipped IN0 OUT0
✓
FinQaCme2010NumberSecuritiesIssuedwhat was the percent of the total number of securities to be issued upon exercise of outstanding options that was securities to be issued upon exercise of outstanding options1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 849 OUT2 076
✓
FinQaCme2017NetStateEffectivewhat is the 3 year average net state effective tax rate?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 280 OUT1 495
✓
FinQaDish2010MinimumLeasePaymentswhat percentage of total minimum lease payments are due after 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 859 OUT858
✓
FinQaDvn2018TaxNetEarningswhat was the tax rate on the net earnings due to the gain on the sale of our aggregate ownership interests in enlink discontinued operations1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 810 OUT1 388
✓
FinQaEtr2008NumberRestrictedUnitswhat is the total number of restricted units expected to vest in the upcoming years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 036 OUT848
✓
FinQaGrmn2006DecreaseObservedOperatingwhat is the decrease observed in the operating leases with payments due to 3-5 years and payments due to more than 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 006 OUT2 490
✓
FinQaGs2012Assetswhat is the percentage change in total assets in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 196 OUT2 652
✓
FinQaGs2014GrowthOperatingExpenseswhat is the growth rate in operating expenses in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 601 OUT2 423
✓
FinQaHolx2003AllOutstandingOptionsif all outstanding options warrants and rights were exercised what would be the total cash inflow?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 233 OUT2 685
✓
FinQaIpg2008NetBalanceUnrecognizedwhat is the net change in the balance of unrecognized tax benefits during 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 229 OUT1 798
✓
FinQaJpm2003StructuredCommercialLoanin 2003 what was the ratio of the structured commercial loan vehicles to credit-linked note vehicles1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 773 OUT1 794
✓
FinQaJpm2003StructuredCommercialLoan2what was the average value of structured commercial loan vehicles issued by vies in 2002 and 2003 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 781 OUT1 572
✓
FinQaMktx2012OctoberDecemberHighfor the period of october 1 2011 to december 31 2011 , what was the difference between high and low share price?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 006 OUT1 492
✓
FinQaMo2014NpmAdjustmentItemswhat are the npm adjustment items as a percentage of the operating companies income increase?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 927 OUT962
✓
FinQaMrk2013InterestPenaltiesAssociatedwhat was the ratio of interest and penalties associated with uncertain tax positions in 2013 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 497 OUT902
✓
FinQaMro2006LiabilityAssetRetirementby what percentage did total amount of the liability for asset retirement obligations increase from 2003 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 000 OUT1 197
✓
FinQaMs2007NetAssetsAcquired2what percentage of the net assets acquired is goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 085 OUT1 111
✓
FinQaMsi2012WeightedEstimatedFairwhat is the percent change of weighted-average estimated fair value of employee stock options between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 482 OUT1 565
✓
FinQaNws2019DeferralRevenueRecognitionwhat was the difference in millions of deferral of revenue and recognition of deferred revenue for the fiscal year ended june 30 , 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 950 OUT1 993
✓
FinQaTmus2017ApproximateSizeEachwhat is the approximate size of each data center leased in square feet1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 060 OUT1 724
✓
FinQaUa2011DecemberScheduledMaturitiesas of december 31 , 2011 what percent of the total scheduled maturities of long term debt is due in 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 366 OUT879
✓
FinQaUnp2010QuarterEndedDecember2for the quarter ended december 312010 what was percent of the total number of shares attested to upc by employees to pay stock option exercise prices1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 904 OUT2 279
✓
FinQaUps2010ExpectedCashOutflowwhat percentage of total expected cash outflow to satisfy contractual obligations and commitments as of december 31 , 2010 are due in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 341 OUT1 539
Reasoning - FinQA annual report calculations (set 17) 32 passed1 failed
97.0%
 IN71 411 OUT51 715
✓
FinQaAal2014ApproximateNumberActivewhat percentage of approximate number of active full-time equivalent employees are passenger service personnel ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 211 OUT908
✓
FinQaAal2014FlightAttendantsPilotswhat is the ratio of the flight attendants to pilots1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 206 OUT733
✓
FinQaAapl2005InventoryWorkingCapitalinventory was what percent of total working capital in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 230 OUT1 269
✓
FinQaAbmd2012RentExpenseFiscalwhat was total rent expense for fiscal years 2010 to 2012 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 322 OUT1 323
✓
FinQaAon2007NetUnrecognizedTaxwhat is the net change amount of unrecognized tax benefits during 2007 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 694 OUT731
✓
FinQaApd2018IncreaseObservedPaymentwhat is the increase observed in the payment of dividends during 2017 and 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 789 OUT1 363
✓
FinQaAwk2012LiabilityReflectedOtherwhat was the combined liability reflected as other long-term liabilities in the accompanying consolidated balance sheets as of december 31 , 2012 and 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 049 OUT1 005
✓
FinQaBll2011NetSalesThreewhat were average net sales in millions for the three years ending in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 270 OUT1 159
✓
FinQaDg2005CostOverLifowhat is the sum of the excess of current cost over lifo cost at february 3 , 2006 and january 28 , 2005 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 314 OUT1 004
✓
FinQaDre2002EarningsServiceOperationswhat was the percentage change in the earnings from service operations increased from 2000 to 20011 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 631 OUT1 248
✓
FinQaEtr2004IncreaseOperationMaintenancewhat is the sum of the listed 2003 increases in other operation and maintenance expenses ( voluntary severance accruals and benefit costs ) as a percentage of 2003 net revenue?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 862 OUT2 617
✓
FinQaEtr2011ReceivablesMoneyPoolby how much did the receivables from the money pool differ from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 342 OUT1 202
✓
FinQaEtr2013GrowthNetRevenuewhat is the growth rate in net revenue for entergy wholesale commodities in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 944 OUT2 762
✓
FinQaFis2012ImpactEurowhat is the percentage change in the impact of euro from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 634 OUT1 458
✓
FinQaGis2017LongTermObligationswhat portion of total long-term obligations are due in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 736 OUT1 771
✓
FinQaGrmn2008GrowthBalanceThroughoutwhat is the difference between the growth of the balance throughout the fiscal year , during 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 280 OUT2 820
✓
FinQaGs2017DividendsDeclaredCommonwhat was the percentage change in dividends declared per common share between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 473 OUT1 525
✓
FinQaGs2017OffBalanceSheetwhat was the change in millions in off-balance-sheet exposures between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 330 OUT1 188
✓
FinQaIlmn2003DecemberNasdaqCompositeat december 292000 what was the ratio of the nasdaq composite index to the nasdaq pharmaceutical index1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 714 OUT2 235
✓
FinQaIpg2008IncreaseUnrecognizedTaxwhat is the percentage increase from beginning to end of 2008 in unrecognized tax benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 230 OUT1 737
✓
FinQaJpm2014NetRevenueDue2what percentage of total net revenue was due to net interest income in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 751 OUT923
✓
FinQaLmt2014CompanyMatchThreewhat was the average of company 401 ( k ) match total for the three years ended 2014 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 306 OUT1 665
✓
FinQaMro2004EndingBalanceDiscountedwhat was the average ending balance in the discounted ending cash flow balance?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 867 OUT1 657
✓
FinQaMs2013DecemberCeventDrivenhow much of the december 31 , 2013 201cevent- driven 201d loans and commitments will mature in 2014 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 085 OUT1 339
✓
FinQaPnc2007DecemberHomeEquityat december 31 , 2007 , what percentage of the $ 14.4 billion of home equity loans ( included in 201cconsumer 201d in the table above ) had a loan-to-value ratio greater than 90%.?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 125 OUT1 055
✓
FinQaPnc2008AcrossThreeCategoriesfor 2008 across the three categories , what were the average mount of liabilities in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 570 OUT1 590
✓
FinQaRsg2010RemainingDiscountNoteswhat was the ratio of the remaining discount of the notes due in 2017 to 20161 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 452 OUT1 400
✓
FinQaRsg2016DecemberOutstandingAuthorizedas of december 31 , 2016 what was the percent of the outstanding authorized purchase capacity of the the october 2015 plan1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 050 OUT2 361
✓
FinQaSna2007RoiSnapInvestmentwhat is the roi in snap-on if the investment was made at the end of 2005 and sold at the end of 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 820 OUT2 039
✓
FinQaSna2018CashOutflowSharewhat is the total cash outflow for the share purchased during november 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 341 OUT2 573
×
FinQaSna2018SharesPurchasedOctoberwhat is the total value of shares purchased during the period from 09/30/18 to 10/27/18 , in dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 66817450, expected: 13435200 Values: difference = 53382250 tolerance = 134352
 Failed IN2 339 OUT2 346
✓
FinQaUaa2016WorkingCapitalwhat was the percentage change in working capital from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 696 OUT973
✓
FinQaUps2012RoiInvestmentwhat is the roi of an investment in s&p500 from 2008 to 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 748 OUT1 736
Reasoning - FinQA annual report calculations (set 18) 32 passed1 failed
97.0%
 IN75 273 OUT52 389
✓
FinQaAal2010DeclineRecordedInternationalwhat was the percentage decline in recorded international slot and route authorities to $ 708 million from $ 736 million as of december 31 , 2010 and 2009 , respectively .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 006 OUT2 235
✓
FinQaAal2015DecemberLaborRelatedas of december 312013 what was the percent of labor-related deemed claim as part of the total reorganization items net1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 106 OUT754
×
FinQaAlxn2016ContractualMaturitiesLongwhat are the total contractual maturities of long-term debt obligations due subsequent to december 31 , 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 5095, expected: 3081 Values: difference = 2014 tolerance = 30.810000000000002
 Failed IN2 416 OUT3 529
✓
FinQaAmt2014AssetImpairmentChargeswas the change in asset impairment charges between 2014 and 2013 in us$ m?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 193 OUT1 475
✓
FinQaAmt2016TaxPenaltieswhat were the average tax penalties from 2014 to 2016 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 422 OUT1 927
✓
FinQaAon2007PercentualIncreaseObservedwhat is the percentual increase observed in the net derivative gains during 2006 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 475 OUT834
✓
FinQaC2009ContractualObligationsMadewhat percent of total contractual obligations in 2011 are made up of long-term debt obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 164 OUT991
✓
FinQaCme2017DecreaseEffectiveTaxwhat was the decrease of the effective tax expense rate between 2015 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 290 OUT1 415
✓
FinQaCme2017FluctuationEffectiveTaxwhat was the fluctuation between the effective tax expense rate and the statutory u.s . federal tax rate in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 294 OUT2 007
✓
FinQaDisca2011CumulativeShareholderReturn2what was the percentage cumulative total shareholder return on discb from september 18 , 2008 to december 31 , 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 908 OUT1 685
✓
FinQaEl2008ConsideringNetDeferredconsidering the 2008 net deferred loss , what is the percentage of amortization expenses?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 574 OUT1 455
✓
FinQaEtr2015AnalysisNetRevenuebased on the analysis of the change in net revenue from 2014 to 2015 what was the percent of the change1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 961 OUT1 760
✓
FinQaFbhs2017SalesWentInternationalwhat was the amount of sales in that went to international markets in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 338 OUT847
✓
FinQaGs2012CollateralPostedwhat was the percentage change in collateral posted between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 280 OUT1 473
✓
FinQaGs2012NetDerivativeLiabilitieswhat was the percentage change in net derivative liabilities under bilateral agreements between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 284 OUT1 640
✓
FinQaGs2014GrowthOperatingExpenses2what is the growth rate in operating expenses in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 601 OUT2 551
✓
FinQaGs2017DividendsDeclaredCommon2what was the percentage change in dividends declared per common share between 2015 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 473 OUT1 569
✓
FinQaGs2017SupplementaryLeverageExposurewhat was the change in millions in total supplementary leverage exposure between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 329 OUT881
✓
FinQaHolx2008PotionAcquisitionPaidwhat potion of the r2 acquisition is paid in cash?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 126 OUT1 899
✓
FinQaIlmn2008CompanyUncertainTaxwhat was the percent of the change in the company 2019s uncertain tax positions from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 110 OUT1 750
✓
FinQaIpg2006InterestExpenseIncurredwhat is the total interest expense incurred by the senior unsecured notes that was redeemed in august 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 574 OUT1 697
✓
FinQaJpm2012LoansRetainedwhat was the percentage change in loans retained from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 299 OUT2 258
✓
FinQaL2009ReturnInvestment2what is the return on investment for s&p500 from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 853 OUT1 571
✓
FinQaLmt2012SharesExcludedCalculationwhat was the ratio of the shares in 2012 to 2011 that were excluded in the calculation of the diluted earnings due to the anti-dilute nature1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 202 OUT1 531
✓
FinQaMrk2013GrowthSales2what is the growth rate in total sales in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 216 OUT1 693
✓
FinQaMro2013OurCrudeOilin 2013 , was the percentage of our u.s . crude oil and condensate production that was sweet higher than 2012 ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 367 OUT819
✓
FinQaMs2013ExposureGovernmentRelatedwhat is the total exposure to government related derivatives , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 003 OUT555
✓
FinQaMsi2007GrowthConsolidatedNetwhat was the growth of consolidated net sales , in percentage , from 2005 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 636 OUT2 806
✓
FinQaPpg2012CumulativeThreeDividendswhat are cumulative three year dividends in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 028 OUT1 142
✓
FinQaSlg2001FairInterestCollarwas the fair value of the interest rate collar greater than the fair value of the interest rate swap?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 643 OUT1 168
✓
FinQaSna2007BalanceMinorityInterestswhat is the percentage change in the balance of the minority interests in consolidated subsidiaries from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 507 OUT988
✓
FinQaUps2012CumulativeReturnInvestmentwhat was the percentage total cumulative return on investment for united parcel service inc . for the five years ended 12/31/2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 754 OUT860
✓
FinQaZbh2008ContractualObligationsDue3what percent of total contractual obligations is due 2012 or after?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 841 OUT2 624
Reasoning - FinQA annual report calculations (set 19) 33 passed
100.0%
 IN73 721 OUT43 360
✓
FinQaAal2014ApproximateNumberActive2what percentage of approximate number of active full-time equivalent employees consist of u.s airways employees?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 214 OUT1 088
✓
FinQaAdbe1999AccrualBalanceRelatedwhat portion of the 1999 accrual balance related to restructurings is comprised of canceled contracts?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 007 OUT1 157
✓
FinQaAes2001ScheduledMaturitiesDebt2what percentage of scheduled maturities of total debt at december 31 , 2001 are due in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 246 OUT710
✓
FinQaAmt2003BostonPropertyWillwhat portion of the boston property will be offered for sub-lease?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 961 OUT1 404
✓
FinQaAwk2012UnrecognizedTaxBenefitswhat was total change in unrecognized tax benefits from january 1 2011 to december 31 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 042 OUT1 350
✓
FinQaBkng2016PricelineGroupIndexwhat was the difference in percentage change in priceline group and the s&p 500 index for the five year period ended 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 559 OUT2 356
✓
FinQaBlk2014CommitmentsDueAfterwhat percent of the commitments are due after 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 867 OUT1 591
✓
FinQaBll2010WithoutChargeSecuritizationwithout the charge for the a/r securitization , what would cash flows provided by operating activities for all operations in 2010 have been ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 171 OUT585
✓
FinQaC2008ConsumerBankingGainwhat was the percentage of the consumer banking gain as part of the 2007 pretax total gain1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 371 OUT1 664
✓
FinQaC2008TaxAppliedCompanywhat was the tax rate applied to the company recorded sales of the mastercard shares in 2007 , the company recorded a $ 367 million after-tax gain ( $ 581 million pretax )1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 395 OUT1 393
✓
FinQaC2009ContractualObligationsMade2what percent of total contractual obligations in 2010 are made up of long-term debt obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 164 OUT779
✓
FinQaC2018PrincipalTransactionsRevenue2what was the percent change of the principal transactions revenue associated with interest rate risks from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 788 OUT1 958
✓
FinQaCb2008NetIncomeCapitalwhat is the net income-to-capital ratio for bermuda subsidiaries in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 321 OUT2 006
✓
FinQaCdns2015ReturnNasdaqInvestmentwhat is the rate of return in nasdaq of an investment from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 828 OUT1 186
✓
FinQaCe2013GrowthDividendsReceived2what is the growth rate in dividends received in 2012 compare to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 263 OUT1 451
✓
FinQaDre2008ImprovementUnbilledReceivableswhat was the percentage improvement in the unbilled receivables on construction contracts from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 327 OUT1 424
✓
FinQaFis2016GrowthGfsSegmentwhat is the growth rate for the gfs segment in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 993 OUT1 311
✓
FinQaGpn2010NonVestedMayin 2009 what was the percentage change in the non-vested at may 31 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 166 OUT1 731
✓
FinQaGs2013NetDerivativeLiabilitieswhat was the percentage change in net derivative liabilities under bilateral agreements from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 176 OUT897
✓
FinQaGs2013SecuritiesCertainOvernight2what percentage of total average securities and certain overnight cash deposits that are included in gce during 2012 were non-u.s . dollar-denominated?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 067 OUT1 678
✓
FinQaGs2013ShareholdersEquitywhat was the change in millions of total shareholders' equity from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 165 OUT804
✓
FinQaHig2004EffectReclassifyingCertainwhat is the total effect of reclassifying certain separate accounts to general account on the net income and other comprehensive income?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 833 OUT871
✓
FinQaHolx2007IntangibleAssetTakenwhat is the total value of intangible assets , including goodwill , taken into account when setting up the estimated purchase price?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 973 OUT1 485
✓
FinQaIntc2015SquareFootOwned2what is the percent of the square foot in millions of owned facilities in the other countries to the of the total owned facilities1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 999 OUT920
✓
FinQaJpm2018LightNetInterestin light of the net interest yield on average interest-earning assets ( managed basis ) , what is the total value of the average assets in 2018 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 698 OUT1 714
✓
FinQaMktx2012LowMktxStockby how much did the low of mktx stock increase from the fourth quarter of 2011 to the first quarter of 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 003 OUT1 604
✓
FinQaMsi2014NumberSharesPurchasedwhat is the percent change in number of shares purchased by employees between 2013 and 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 693 OUT1 084
✓
FinQaPnc2012CommercialMortgageLoans3commercial mortgage loans held for sale designated at fair value at december 31 , 2012 were what percent of total loans held for sale?,1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 526 OUT1 468
✓
FinQaPnc2012TwoSpecificReserveswhat was the two-year total for specific reserves in the alll , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 292 OUT625
✓
FinQaPpg2008DecemberUnrecognizedTaxas of december 31 , 2008 , what percentage of unrecognized tax benefits would not impact the effective if recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 428 OUT1 495
✓
FinQaRsg2012AdditionsChargedExpensewhat was the percentage change in the additions charged to expense from 2011 to 2012 as part of the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 041 OUT937
✓
FinQaTmus2017SizeSquareFeet2what is the average size ( in square feet ) of switching centers in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 067 OUT1 371
✓
FinQaUps2016Vehicleswhat was the change in millions of vehicles from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 077 OUT1 263
Reasoning - FinQA annual report calculations (set 2) 32 passed1 failed
97.0%
 IN72 963 OUT53 303
✓
FinQaAbmd2005CompensationExpenseRelateddid compensation expense related to the company 2019s employee stock purchase plan grow from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 212 OUT695
✓
FinQaAbmd2008AssumingSameLevelassuming the same level of reductions for closing of the applicable statute of limitations as in fiscal 2008 , what would be the ending balance at march 31 2009 , in thousands , for unrecognized tax benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 356 OUT1 263
✓
FinQaAes2010AnnualInterestCostwhat is the annual interest cost savings by the company redeeming the 8.75% ( 8.75 % ) second priority senior secured notes?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 131 OUT1 195
✓
FinQaAon2007NetAonUnpaidwhat is the net change in aon 2019s unpaid restructuring liabilities during 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 535 OUT1 673
✓
FinQaBll2010DecreaseCashFlowswhat was the percentage decrease in cash flows from operations from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 159 OUT2 686
✓
FinQaCme2010AssumingAllOptionsassuming all options in the compensation plans approved by security holders were exercised , what would be the deemed proceeds to the company?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 844 OUT943
✓
FinQaEtfc2007DecemberSquareFootage2as of december 2007 what was the percent of the square footage in alpharetta georgia not yet leased1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 300 OUT1 574
✓
FinQaEtfc2011DecemberCollateralPledgedas of december 31 , 2010 , what was the ratio of collateral pledged to the bank by its derivatives counterparties to overnight and other short-term borrowings1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 536 OUT1 695
✓
FinQaEtfc2012DecemberSquareFootageas of december 2012 what is the percent of the square footage not leased to the total square footage in alpharetta , georgia1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 952 OUT1 517
✓
FinQaEtr2004GrowthNetRevenuewhat is the growth rate in net revenue for entergy mississippi , inc . in 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 863 OUT1 242
✓
FinQaEtr2013NetRevenueEntergywhat is the net change in net revenue for entergy wholesale commodities during 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 944 OUT1 288
✓
FinQaEtr2013NuclearRealizedPricewhat are the nuclear realized price changes as a percentage of the decrease in net revenue from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 953 OUT2 197
×
FinQaFbhs2017DecemberGrantedShareas of december 31 , 2017 what was the value of the granted share awards1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 58.02, expected: 9294571.92 Values: difference = 9294513.9 tolerance = 92945.7192
 Failed IN2 155 OUT2 023
✓
FinQaFbhs2017WeightedFairDatewhat was the percentage change in the weighted average fair value on the date of the award of the common stock1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 155 OUT2 068
✓
FinQaFis2012ImpactEuroEarningswhat was the percentage change in the impact of the euro on earnings from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 637 OUT1 557
✓
FinQaFis2016CashFlowsOperationswhat was the percentage change in cash flows from operations from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 360 OUT1 119
✓
FinQaFis2017RevenueGeneratedNonwhat is the percentage change in revenue generated from non-us currencies from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 126 OUT2 115
✓
FinQaGis2017FutureEstimatedCashin 2017 what was the percent of the total future estimated cash payments under existing contractual obligations associated with long-term debt that was due in 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 755 OUT2 714
✓
FinQaGpn2014SecuritiesIssuedApprovedwhat is the total value of securities issued and approved by security holders , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 869 OUT2 244
✓
FinQaGs2013CumulativeReturnGoldmanwhat was the difference in percentage cumulative total return for goldman sachs group inc . and the s&p 500 index for the five year period ending 12/31/13?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 912 OUT2 464
✓
FinQaGs2017StockOptionsCancelledwhat is the total amount of stock options cancelled in millions during 2017 , 2016 and 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 479 OUT1 854
✓
FinQaHig2004AdoptionProspectiveMethodin the adoption of the prospective method what was the ratio of the other comprehensive income to the net income reclassifying certain separate accounts to general account1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 838 OUT1 349
✓
FinQaHolx2007EstimatedPurchasePricewhat portion of the estimated purchase price is derived by the net tangible assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 968 OUT1 252
✓
FinQaK2006CashFlowwhat was the average cash flow from 2004 to 20061 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 609 OUT1 530
✓
FinQaMktx2004SharesCommonStockin 2004 and 2003 , what were the total shares of common stock that were issued to employees?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 201 OUT612
✓
FinQaNws2017IntangibleAssetsRelatedwhat percentage of the intangible assets is related to the license of the realtor.com ae trademark?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 017 OUT1 694
✓
FinQaPnc2012AmortizedAssetsMadein 2012 what was the percent of the total amortized assets that was made of total securities available for sale1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 453 OUT1 906
✓
FinQaPnc2012CarryingInvestmentSecuritieswhat percentage of the total carrying amount of investment securities is the securities held to maturity?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 445 OUT2 187
✓
FinQaPnc2012CommercialMortgageLoans2commercial mortgage loans held for sale designated at fair value at december 31 , 2011 were what percent of total loans held for sale at december 31 , 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 537 OUT968
✓
FinQaSna2018QuarterEndedSharesfor the quarter ended 12/29/2018 what was the percent of the total shares bought after 11/25/20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 358 OUT1 911
✓
FinQaStt2009SharesPurchasableUnderwhat is the total value , in dollars , of the shares purchasable under the warrant?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 447 OUT1 633
✓
FinQaUa2007NovemberStockIssuein november 2005 what was the percent of the stock issue costs to the company proceeds1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 019 OUT1 110
✓
FinQaZbh2008ContractualObligationsCategorizedwhat percent of total contractual obligations is categorized as long term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 838 OUT1 025
Reasoning - FinQA annual report calculations (set 20) 33 passed
100.0%
 IN73 503 OUT47 218
✓
FinQaAal2013AagSeriesPreferredwhat is the ratio of the aag series a preferred stock to single-dip equity obligations1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 452 OUT556
✓
FinQaAal2013AmericansLaborRelatedwhat is the percent of americans labor-related deemed claim as a part of the total claims and other bankruptcy settlement obligations as of december20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 464 OUT1 040
✓
FinQaAapl2006OppenheimerRsusVestif mr . oppenheimer's rsus vest , how many total shares would he then have?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 295 OUT1 140
✓
FinQaAapl2006TaxExpense2what was the 2005 tax expense?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 023 OUT872
✓
FinQaAdbe2008YearlyAmortizationTrademarkswhat is the yearly amortization rate for the trademarks?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 957 OUT1 181
✓
FinQaAes2001FirstQuarterHighwhat was the 2001 first quarter average of high and low stock prices?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 792 OUT647
✓
FinQaAes2002RentalExpenseThroughwhat was the average sale/leaseback rental expense in millions for 2000 through 2002?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 033 OUT1 447
✓
FinQaAmt2007GrowthPriceShareswhat is the growth rate in the price of shares purchased by employees from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 686 OUT2 321
✓
FinQaAmt2007WeightedFairEsppwhat was the percentage change in the weighted average fair value for the espp shares purchased from 2005 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 689 OUT2 218
✓
FinQaAmt2008DecemberMaturitiesAggregateas of december 31 , 2008 , what was the percent of the maturities in 2012 of the aggregate carrying value of long-term debt , including capital leases1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 348 OUT2 461
✓
FinQaAmt2016NumberSharesRegisteredwhat is the average number of shares per registered holder as of february 17 , 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 043 OUT1 016
✓
FinQaAon2007NetUnrealizedInvestmentwhat are the average net unrealized investment gains for the period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 463 OUT920
✓
FinQaCmcsa2015UnrecognizedTaxBenefits2what was the change in unrecognized tax benefits from the end of 2013 to the end of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 285 OUT2 198
✓
FinQaD2002EstimatedPaymentsUnderestimated payments under natural gas pipeline and storage capacity commitments for the next three years total how much , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 782 OUT893
✓
FinQaDish2011WorkingCapitalBlockbusterwhat is the working capital of blockbuster at the point of acquisition?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 021 OUT1 641
✓
FinQaEtfc2011DecemberLoansMaturityas of december 312011 what was the ratio of the loans with a maturity in 2037 to the loans with a maturity in 20331 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 538 OUT1 528
✓
FinQaEtfc2012Otti2what was the percentage change in otti between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 975 OUT2 098
✓
FinQaEtr2004MoneyPoolActivity2what is the money pool activity use of operating cash flows as a percentage of receivables from the money pool in 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 158 OUT2 777
✓
FinQaFis2016GrowthIfsSegmentwhat is the growth rate for the ifs segment in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 992 OUT1 336
✓
FinQaGis2019NetSaleswhat was the percent of the change in the net sales from 2017 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 157 OUT1 560
✓
FinQaIpg2017ContingentAcquisitionPaymentswhat portion of the total contingent acquisition payments is related to deferred acquisition payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 218 OUT775
✓
FinQaLmt2014EstimatedFutureBenefitin 2014 what was the ratio of the estimated future benefit payments due in 2015 compared to the amount after 20201 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 324 OUT953
✓
FinQaLmt2015DilutedEarningsCommonwhat was the percentage change in diluted earnings per common share from continuing operations from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 331 OUT1 258
✓
FinQaMmm2013CompanyContributionPensionwhat was the ratio of the company contribution in 2011 to the amount in 2013 to the us pension contributions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 711 OUT1 779
✓
FinQaMro2003AsphaltSalesThreewhat was the sum of asphalt sales volumes , in thousands of barrels per day , for the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 169 OUT1 125
✓
FinQaMsi2008OperatingEarningsSegmentin 2006 what was the percent of the operating earnings to the segment net sales1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 541 OUT1 565
✓
FinQaMsi2012SharePriceApplicablein 2011 what was the average share price applicable to the employee purchases of 2.2 millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 477 OUT1 882
✓
FinQaPnc2015InterestOnlyProductsfor interest only products , what percent of the total was due in 2020 and thereafter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 532 OUT1 511
✓
FinQaRsg2013GrowthWeightedEstimatedwhat was the growth of the weighted-average estimated fair values of stock options granted from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 930 OUT1 146
✓
FinQaRsg2016WeightedCostSharewhat was the percent of the change in the weighted average cost per share from 2015 to 20161 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 043 OUT1 283
✓
FinQaUnp2009CostCapitalLeasewhat is the total cost in millions of capital lease obligation , principal only?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 309 OUT1 260
✓
FinQaVno2014FiveIndexwhat was the five year change in the s&p 500 index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 595 OUT1 458
✓
FinQaVrtx2006GrossPropertyEquipmentwhat percent of the gross total property and equipment values in 2006 are related to computers?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 170 OUT1 373
Reasoning - FinQA annual report calculations (set 21) 30 passed3 failed
90.9%
 IN71 809 OUT51 372
✓
FinQaAbmd2006OperatingLeaseCommitmentsoperating lease commitments are what percent of total payment commitments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 190 OUT850
✓
FinQaAes2010RecourseDebtDecember2what percentage of recourse debt as of december 31 , 2010 matures after 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 123 OUT1 149
✓
FinQaAnss2012EndedDecemberRevenuefor the year ended december 312012 what was the percent of the revenue by geographic area that was from the united states1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 433 OUT669
✓
FinQaAon2018ConsideringLiabilityUncertainconsidering the years 2016-2018 , what is the average liability for uncertain tax positions , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 165 OUT1 352
✓
FinQaBll2010NetSalesDiscontinued2what was the percentage change in net sales for the discontinued operations between 2009 and 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 318 OUT1 767
✓
FinQaC2009TaxAppliedGoodwillwhat was the tax rate applied applied to the goodwill impairment charge in the fourth quarter of 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 051 OUT810
✓
FinQaC2015NetOutflowsDecwhat was the difference in billions in net outflows from dec . 31 , 2014 to dec . 31 , 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 391 OUT1 334
✓
FinQaC2018PrincipalTransactionsRevenue3what percentage of total principal transactions revenue in 2016 was do to interest rate risks?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 781 OUT1 127
×
FinQaCme2010ApprovedEquityCompensationwhat is the total value of the approved equity compensation plans in 2005 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 5.156, expected: 373.15316 Values: difference = 367.99716 tolerance = 3.7315316000000003
 Failed IN1 843 OUT4 770
✓
FinQaDvn2014IncreaseOccurredOctwhat percentage increase occurred from oct 24 , 2017 to oct 24 , 2018 of senior credit facility maturity?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 146 OUT1 911
✓
FinQaEcl2017AniosPurchasingPricewhat portion of anios' purchasing price is related to goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 984 OUT1 669
✓
FinQaEmr2017GrantDateFairat the average grant date fair value per share what is the value in thousands of the shares outstanding but not yet earned under incentive shares at the end of the year ? \\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 600 OUT1 756
✓
FinQaEtr2003EntergyEmployeesRepresentedwhat portion of the total entergy employees is represented by unions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 623 OUT770
×
FinQaFis2012UnfavorableImpactOperatingby how much were operating expenses reduced in 2012 as a result of the stronger u.s . dollar , based on the foreign currency impact on revenue and operating income , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 9.0, expected: 91.8 Values: difference = 82.8 tolerance = 0.918
 Failed IN1 635 OUT1 882
✓
FinQaGis2017AnticipatedBenefitsPaymentsin 2018 what was the ratio of anticipated benefits payments from our unfunded postemployment benefit plans to the deferred compensation1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 746 OUT1 196
✓
FinQaGis2018IssuedGuaranteesComfortwhat is the total value of issued guarantees and comfort letters for consolidated subsidiaries and non-consolidated affiliates , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 038 OUT515
✓
FinQaHum2017DeclineAmortizationExpensewhat was the percent of the decline in amortization expense for other intangible assets from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 421 OUT1 800
✓
FinQaJpm2008ImpactDvaBasis2what was the total impact on dva of a 1 basis point increase in jpmorgan chase credit spread for 2008 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 595 OUT1 381
✓
FinQaLmt2014EstimatedFutureBenefit2what is the difference in estimated future benefit payments for retiree medical and life insurance plans between 2015 and 2016 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 310 OUT937
✓
FinQaMas2012IncreasePerformanceIndexwhat was the percent of the increase in the performance of the s&p 500 index from 2008 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 965 OUT1 284
×
FinQaMro2003ProtectCarryingValues2by what percentage did protect carrying values of excess inventories increase from 2002 to 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: -0.39024, expected: 0.39024 Values: difference = 0.78048 tolerance = 0.0039024
 Failed IN2 191 OUT3 068
✓
FinQaMro2006LiabilityAssetRetirement2by what percentage did total amount of the liability for asset retirement obligations increase from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 000 OUT1 667
✓
FinQaMro2011DevelopmentCostsThreewhat were total development costs in millions for the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 747 OUT1 021
✓
FinQaNclh2018AccredInterestLiabilitywhat is the percentage change in accred interest liability in 2018 compare to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 217 OUT2 067
✓
FinQaPnc2012TwoSpecificReserves2what was the two-year total for specific reserves in the alll , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 292 OUT1 035
✓
FinQaPpg2018IncreaseNewJerseywhat was the percentage increase in the new jersey chrome environmental reserve in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 388 OUT1 061
✓
FinQaRsg2012AllowanceDoubtfulAccountswhat was the change in the allowance for doubtful accounts in 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 026 OUT1 549
✓
FinQaStt2011AggregateRestructuringChargeswhat was the percent of the aggregate restructuring charges recorded in 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 208 OUT1 932
✓
FinQaUnp2006BothMainLinewhat is the percent of both the main line and branch line routes that are owned by the company1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 065 OUT1 791
✓
FinQaUnp2009CostLocomotiveOctoberwhat was the average cost per locomotive , in millions of dollars , for the october 15 , 2009 purchase by the railroad?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 320 OUT2 007
✓
FinQaUps2007ExpectedCashOutflow2what percentage of the total expected cash outflow to satisfy contractual obligations and commitments as of december 31 , 2007 , is pension fundings?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 341 OUT1 920
✓
FinQaUps2007ExpectedCashOutflow3what portion of total expected cash outflow for capital leases is due in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 328 OUT1 986
✓
FinQaUps2007ExpectedCashOutflow4what portion of total expected cash outflow for operating leases is due in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 328 OUT1 339
Reasoning - FinQA annual report calculations (set 22) 33 passed
100.0%
 IN73 166 OUT49 923
✓
FinQaAal2013CostAircraftFuelwhat is the percentage change in total cost of aircraft fuel in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 525 OUT1 959
✓
FinQaAal2013GrowthPriceAircraftwhat is the growth rate in the price of aircraft fuel per gallon from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 533 OUT1 266
✓
FinQaAal2013OperatingCostsin 2011 what was the total operating costs in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 521 OUT2 069
✓
FinQaAal2014AmericanPersonnelAirwayswhat is the ratio of the total american personnel to us airways personnel1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 209 OUT1 428
✓
FinQaAapl2006LowestEffectiveTaxwhat was the lowest effective tax rate in the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 025 OUT1 019
✓
FinQaAdi2010GrowthBalanceMoneywhat is the growth rate in the balance of money market funds in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 101 OUT1 602
✓
FinQaAes2002DiscontinuedOperationsRepresenttotal discontinued operations represent what percentage of total future minimum lease commitments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 021 OUT1 083
✓
FinQaAmt2008NetBalanceLiability2what is the net change in the balance of liability related to employee separations during 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 446 OUT1 757
✓
FinQaAmt2012SpentStockRepurchases2was was the total amount spent on stock repurchases in the fourth quarter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 990 OUT2 231
✓
FinQaAmt2016NetBalanceUnrecognizedwhat is the net change in the balance of unrecognized tax benefits during 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 421 OUT2 247
✓
FinQaBkng2016PricelineGroupFivewhat was the percentage change in priceline group for the five year period ended 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 548 OUT778
✓
FinQaBll2011GrowthNetSaleswhat is the growth rate in net sales from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 272 OUT1 704
✓
FinQaCme2010WhatsEquityCompensationwhats is the percentage of equity compensation plans that were not approved by security holders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 836 OUT2 443
✓
FinQaDish2010MinimumLeasePayments2what percentage of total minimum lease payments are due in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 859 OUT1 259
✓
FinQaDre2007BasicNetIncomewhat was the average basic net income available for common shareholders from 2005 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 186 OUT1 239
✓
FinQaEcl2017CarryingGoodwill2what is the percentage change in the total carrying amount of goodwill from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 463 OUT1 721
✓
FinQaEtr2004DecreaseGrossWholesalewhat is the decrease in gross wholesale revenue as a percentage of 2003 net revenue?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 860 OUT1 801
✓
FinQaEtr2008IssuableLongTermwhat is the total value , in millions of dollars , of tax-exempt bonds and other long-term securities that entergy gulf states louisiana requested authority to issue?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 150 OUT648
✓
FinQaEtr2011NetRevenuewhat is the percentage change in net revenue from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 873 OUT927
✓
FinQaEtr2016NetRevenueDuefor 2016 , what percentage of net revenue was due to the retail electric price adjustment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 819 OUT1 926
✓
FinQaGpn2018UnvestedRestrictedStock2what was the value in thousands of unvested restricted stock and performance awards at the weighted-averagegrant-datefair value as of december 31 , 2018?\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 309 OUT1 753
✓
FinQaJpm2010FirmPledgedAssetswhat was the percent of the firm 2019s total pledged assets in 2010 that was loans1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 930 OUT942
✓
FinQaKhc2018SharesIssuedhow many shares were issued during the period of 2016 to 2018 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 238 OUT1 646
✓
FinQaLmt2012WeightedCommonShares2what is the percentage change in the weighted average common shares outstanding for basic computations from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 193 OUT1 118
✓
FinQaLmt2012WeightedCommonShares3what was the percent of the change in weighted average common shares outstanding for diluted computations from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 193 OUT1 245
✓
FinQaMo2014EarningsBasicDilutedwhat is the percent change in earnings for basic and diluted eps from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 899 OUT1 225
✓
FinQaMrk2013ConsideringSettlementsconsidering the years 2011-2013 , what is the average value of settlements as presented in the table ( reductions shown as negative values ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 506 OUT1 615
✓
FinQaMro2017InitialHealthCare3what is the difference in the initial health care trend rate and the ultimate health care trend rate in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 468 OUT1 633
✓
FinQaPkg2002BalanceOptionsDecemberwhat is the total value of the balance of options as of december 31 , 2002 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 993 OUT1 797
✓
FinQaPkg2005PurchaseCommitmentsOvertotal purchase commitments over the next two years are what ( in thousands ) ?\\n\\n\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 998 OUT322
✓
FinQaSlg2011AccountBalancein 2011 what was the percent change in the restricted stock balance from the beginning of the year to the end of the year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 453 OUT2 281
✓
FinQaUaa2016DebtEquitywhat is the debt-to-equity ratio in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 690 OUT1 424
✓
FinQaZbh2007ConsultingProfessionalFeeswhat is the percent change in consulting and professional fees from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 638 OUT1 815
Reasoning - FinQA annual report calculations (set 23) 31 passed2 failed
93.9%
 IN68 940 OUT47 394
✓
FinQaAbmd2007ExpectedVolatilityUsedwhat is the average expected volatility used in the black scholes formula?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 499 OUT1 573
×
FinQaAdi2011YearlyInterestPaymentwhat is the yearly interest payment related to the $ 375 million notional amount included in the swap terms?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.05, expected: 18.75 Values: difference = 18.7 tolerance = 0.1875
 Failed IN2 422 OUT1 369
✓
FinQaAlle2015ConsideringVariationExpensesconsidering the year 2014 , what are the variation between the expenses for environmental remediation at sites and the reserves environmental matters , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 314 OUT2 099
✓
FinQaAon2018DecreaseObservedAdditionswhat is the decrease observed in the additions for tax positions of prior years , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 150 OUT1 146
✓
FinQaAwk2017MaximumBorrowingsOutstandingby what percentage did maximum borrowings outstanding increase from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 161 OUT875
✓
FinQaC2018PrincipalTransactionsRevenue4what was the percent of the principal transactions revenue associated with foreign exchange risks in 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 781 OUT1 057
✓
FinQaCme2017CmeGroupInc2in 2017 what was the ratio of the the cme group inc . stock perfomamce to the s&p1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 755 OUT1 514
×
FinQaDvn2015RangeGrantDatewhat is the range of the 2014 grant-date fair value?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 70.18-81.05, expected: 10.87 Values: difference = 59.31000000000001 tolerance = 0.10869999999999999
 Failed IN2 186 OUT1 969
✓
FinQaEcl2016ContractualObligationsDuewhat portion of the total contractual obligations is due in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 473 OUT1 305
✓
FinQaEtr2003EntergyStaffEmployedwhat portion of the total entergy staff is employed at entergy operations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 625 OUT675
✓
FinQaEtr2008AnnualInterestExpensewhat is the annual interest expense related to series first mortgage bonds due may 2018 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 139 OUT1 330
✓
FinQaFis2016ConsolidatedRevenuesGfs2what percent of total consolidated revenues in 2016 was the gfs segment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 994 OUT554
✓
FinQaFis2017RevenueGeneratedNon2what is the percentage change in revenue generated from non-us currencies from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 126 OUT1 583
✓
FinQaGpn2014SecuritiesApprovedSecuritywhat is the total value of securities approved by security holders but net yer issued , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 893 OUT1 734
✓
FinQaGs2012LargestTierCapitalin millions for 2012 and 2011 , what was the largest tier 1 capital amount?\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 487 OUT736
✓
FinQaGs2014OtherLiabilitiesAccruedwhat percentage of total other liabilities and accrued expenses in 2014 are due to compensation and benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 196 OUT2 020
✓
FinQaGs2017CapitalFrameworkMinimumfor the capital framework , what percent of the minimum supplementary leverage ratio consisted of a buffer?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 323 OUT2 002
✓
FinQaHii2015OperatingMarginQuarterwhat was the operating margin in the 4th quarter1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 852 OUT1 595
✓
FinQaHolx2006EstimatedPurchasePrice2what percentage of the estimated purchase price is developed technology and know how?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 075 OUT1 337
✓
FinQaIlmn2003CumulativeStockholderReturn2what was the cumulative total stockholder return percentage for illumina inc . common stock for the four years end 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 716 OUT1 361
✓
FinQaIlmn2008GrowthCompanyMadewhat was the percent of the growth in the company made matching contributions from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 104 OUT1 582
✓
FinQaIntc2013FiveCumulativeReturnwhat was the percentage five-year cumulative return for intel for the five years ended 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 641 OUT1 522
✓
FinQaIntc2013FiveCumulativeReturn2what was the difference in percentage five-year cumulative return for intel versus the s&p 500 index for the five years ended 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 652 OUT2 617
✓
FinQaJkhy2017ReturnPeerGroupwhat was the change in the peer group cumulative total return index value from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 770 OUT645
✓
FinQaJpm2009Equitywhat were total average trading assets less total average trading liabilities in 2009 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 803 OUT1 353
✓
FinQaJpm2015NetRevenueInterestwhat percentage of total net revenue in 2014 was net interest income?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 750 OUT1 483
✓
FinQaMas2012CumulativeReturnMascowhat was the percentage cumulative return of masco for the five year period ending 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 955 OUT1 874
✓
FinQaMmm2007InterestExpenseIncomein 2007 what was the ratio of the interest expense to the interest income1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 371 OUT1 705
✓
FinQaMro2013NetUndevelopedAcres2by how much did net undeveloped acres expiring decrease from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 421 OUT2 341
✓
FinQaSna2013FiveStockPerformancein the five-year stock performance graph what was the ratio of the of the snap-on incorporated to the peer group performance in december 31 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 811 OUT710
✓
FinQaStt2011AggregateRestructuringCostswhat was the percent of the aggregate restructuring costs that were employee-related costs in 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 212 OUT834
✓
FinQaUnp2006DecemberRouteMilesas of december 31 , 2006 what was the percent of the total route miles covered by the main line1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 075 OUT1 613
✓
FinQaUnp2016OurNetworkRoutewhat is the percent of our network route miles that is owned rather than operated on pursuant to trackage rights or leases1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 208 OUT1 281
Reasoning - FinQA annual report calculations (set 24) 33 passed
100.0%
 IN73 344 OUT50 786
✓
FinQaAmt2005ImpairmentChargesNet2what is the percentage change in impairment charges and net losses from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 478 OUT1 987
✓
FinQaAon2007NetAonUnpaid2what is the net change in aon 2019s unpaid restructuring liabilities during 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 535 OUT847
✓
FinQaAwk2017GrowthBorrowingsOutstandingwhat was the percent growth of borrowings outstanding from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 160 OUT1 547
✓
FinQaBlk2012EquityComponentChangeswhat is the percent change in equity component changes from 12/31/2011 to 12/31/2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 490 OUT2 444
✓
FinQaBlk2015RentExpenseCertainwhat is the value of rent expense and certain office equipment expense under lease agreements , between 2013 and 2015 ? in million $ .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 761 OUT1 419
✓
FinQaBll2011GrowthNetSales2what is the growth rate in net sales from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 272 OUT1 516
✓
FinQaCdw2015MoreMoneyExpensedhow much more money was expensed per outstanding basic weighted-average share in the year ended dec 31 , 2013 compared to the year ended dec 31 , 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 279 OUT4 214
✓
FinQaCe2016NetSpentResearch2what is the net change in the amount spent for research and development in 2015 compare to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 152 OUT1 107
✓
FinQaCmcsa2008ScalableInfrastructureRepresents2scalable infrastructure represents what percent of capital expenditures incurred the cable segment during 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 294 OUT882
✓
FinQaDg2005ExcessCurrentCostwhat was the percentage change in the excess of current cost over lifo cost was approximately between 2006 and 2005 .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 303 OUT1 900
✓
FinQaDisca2011SeriesStockOutperformdid the b series stock outperform the a series based on 5 year total return?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 892 OUT697
✓
FinQaDish2011HardAssetsBlockbusterhard assets were what percent of the total blockbuster purchase price?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 010 OUT2 573
✓
FinQaDvn2014DecemberDebtMaturitiesat december 31 , 2014 what was the ratio of the debt maturities scheduled for 2015 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 154 OUT1 676
✓
FinQaEtr2015NetRevenueAttributedwhat percentage of net revenue of 2015 is attributed to the growth from to retail electric price?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 954 OUT965
✓
FinQaEtr2016CostWouldPassedhow much cost would be passed on to customers , in millions , due to the retail electric price variance over the next 3 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 829 OUT564
✓
FinQaFis2017IncreaseDecreaseWould2what percent of the total increase or decrease would the euro be in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 120 OUT1 616
✓
FinQaGpn2010AfterTaxShare2what is the percentage change in the after-tax share-based compensation cost from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 182 OUT1 736
✓
FinQaGs2014Assetswhat is the percentage in total assets in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 458 OUT1 747
✓
FinQaHii2015SalesDecemberwhat was the total sales as of december 312014 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 858 OUT1 404
✓
FinQaIpg2008BalanceUnrecognizedTaxwhat percentage of balance of unrecognized tax benefits at the end of 2008 would impact the effective tax rate if recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 236 OUT1 009
✓
FinQaJpm2014WholesaleCreditRelatedwhat was the percentage change in total wholesale credit-related assets from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 472 OUT1 124
✓
FinQaLmt2015NetProfitMarginin 2015 what was the net profit margin1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 316 OUT2 512
✓
FinQaLmt2016NetSalesMfcwhat were average net sales for mfc in millions between 2014 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 445 OUT1 302
✓
FinQaMro2004SharesRepurchasePeriodshow many total shares were repurchase in the periods 11/01/04 2013 11/30/04 and \\n12/01/04 2013 12/31/04?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 281 OUT676
✓
FinQaMs2013CompanyHaveMoredid the company have more exposure to the insurance industry than the real estate industry in its derivative portfolio?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 010 OUT516
✓
FinQaMsi2007NetSalesSegmentin 2006 , what was the net sales to the segment 2019s top five customers in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 638 OUT2 047
✓
FinQaNws2019NonCashAssetswhat was the value in millions of non cash assets for the transaction in which opcity was acquired?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 948 OUT1 080
✓
FinQaPnc2008NationalCitySponsoredfor national city-sponsored securitization qspes at december 31 , 2008 , automobile was what percent of credit card assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 580 OUT1 383
✓
FinQaPnc2012WouldAmortizedCostswhat would the amortized costs of total securities available for sale be without the $ 367 million of amortized cost of securities classified as corporate stocks as of december 31 , 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 472 OUT1 776
✓
FinQaRsg2009DeclineWeightedEstimatedwhat was the percentage decline in the weighted- average estimated fair values of stock options from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 884 OUT2 647
✓
FinQaSna2013OtherAccruedLiabilitieswhat was the percent of the change in the total other accrued liabilities from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 353 OUT962
✓
FinQaStt2009AggregateNetAssetwhat was the percent change in the aggregate net asset values of the direct lending collateral pools between 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 904 OUT1 575
✓
FinQaZbh2015TaxBenefitReducewhat percent did the tax benefit reduce expenses in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 624 OUT1 336
Reasoning - FinQA annual report calculations (set 25) 33 passed
100.0%
 IN74 991 OUT46 609
✓
FinQaAmt2016NetBalanceUnrecognized2what is the net change in the balance of unrecognized tax benefits during 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 421 OUT2 566
✓
FinQaAnss2016DecemberCompanySignificantas of december 31 , 2016 what was the percent of the company's total significant contractual obligations that was for the global headquarters operating lease?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 056 OUT1 188
✓
FinQaBll2006NetAssetsAcquired2what percentage of total net assets acquired were goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 018 OUT710
✓
FinQaC2015HqlaDecwhat was the difference in billions in hqla from dec . 31 , 2014 to dec . 31 , 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 391 OUT1 505
✓
FinQaCb2008GrowthNetIncomewhat is the growth rate in the net income of bermuda subsidiaries from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 328 OUT1 775
✓
FinQaCme2010AnnualInterestExpensewhat is the annual interest expense on the fixed rate notes due march 2018 after the hedge transaction?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 400 OUT1 627
✓
FinQaCme2017CmeGroupOutperformdid the cme group outperform the s&p 500 over 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 747 OUT568
✓
FinQaDisca2014AfterSeriesOutperformafter 4 years , did the series c outperform the s&p 500?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 181 OUT1 390
✓
FinQaDish2011TerrestarAcquisitionWillfor the terrestar acquisition what will the final cash purchase price be in millions paid upon closing?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 021 OUT656
✓
FinQaDvn2012DecemberDevonDebtas of december 31 , 2012 what was the ratio of the devon debt maturities in 2013 compared to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 930 OUT652
✓
FinQaDvn2015ContractualTermin years , what is the average contractual term for 2013 , 2014 , 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 198 OUT1 359
✓
FinQaDxc2018FiscalCostsExpensesin fiscal 2018 what percentage of total costs and expenses was costs of services ( excludes depreciation and amortization and restructuring costs ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 340 OUT1 942
✓
FinQaDxc2018FiscalCostsExpenses2in fiscal 2018 what percentage of total costs and expenses was selling general and administrative ( excludes depreciation and amortization and restructuring costs ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 341 OUT2 674
✓
FinQaEtr2004NetRevenueEntergywhat is the net change in net revenue entergy mississippi , inc . during 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 862 OUT1 298
✓
FinQaEtr2008ReceivablesMoneyPoolwhat is the percent change in receivables from the money pool between 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 142 OUT1 374
✓
FinQaGis2015MayUnrealizedLossesin may 2015 what was the ratio of the unrealized losses from interest rate cash flow hedges to the unrealized gains from foreign currency cash flow hedges1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 252 OUT2 366
✓
FinQaGpn2013NumberGrantsForfeitedwhat was the total number of grants were forfeited?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 091 OUT1 281
✓
FinQaGs2014CompensationBenefitsLiabilityin millions for 2014 and 2013 , what was the change in compensation and benefits liability?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 199 OUT1 235
✓
FinQaGs2015SecuritiesBorrowedFairwhat percentage of securities borrowed were at fair value for december 31 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 213 OUT1 836
✓
FinQaGs2018LowestAlternativeInvestmentsin billions for 2018 , 2017 , and 2016 , what was the lowest amount of alternative investments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 574 OUT1 380
✓
FinQaHolx2007IssuedSecuritiesApprovedwhat is the total value of issued securities that are approved by security holders , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 129 OUT2 105
✓
FinQaIntc2013CumulativeReturnIntelin 2010 what was the ratio of the cumulative return for intel , to the the dow jones u.s . technology index*1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 649 OUT1 819
✓
FinQaJpm2018BasisPointsNet2by how many basis points did net interest yield on average interest-earning assets 2013 managed basis improve form 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 695 OUT1 604
✓
FinQaMktx2004DecemberCommonStockas of december 31 , 2004 , what percentage of common stock outstanding were non-voting shares?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 208 OUT1 571
✓
FinQaMro2003MapGrowthGasolinewhat was map's 3 year growth of gasoline production?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 174 OUT1 446
✓
FinQaMro2006FinLiabilityGreaterwas the fin 47 liability greater on december 31 2004 than december 31 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 002 OUT426
✓
FinQaMro2013PriceWtiCrudeby what percentage did the average price of wti crude oil increase from 2011 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 361 OUT1 156
✓
FinQaPnc2012OtherLoansHeldwhat was the average for "other" loans held in 2012 and 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 518 OUT1 062
✓
FinQaPnc2012SpecificReservesAlllthe specific reserves in the alll as of december 31 , 2012 were what percent of the tdr portfolio?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 303 OUT1 171
✓
FinQaSna2013SalesPaymentsReceivedwhat was the change in trade and other accounts receivable ( before allowances ) from 2012 to 2013 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 121 OUT1 570
✓
FinQaStt2011RestructuringCostComeswhat percentage of restructuring cost comes from employee-related costs?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 203 OUT719
✓
FinQaV2010PaymentVolumeTransactionwhat is the average payment volume per transaction for visa inc?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 133 OUT966
✓
FinQaZbh2009OperatingLeaseswhat was the percent change in operating leases between 2011/12 and 2013/4?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 790 OUT1 612
Reasoning - FinQA annual report calculations (set 26) 31 passed2 failed
93.9%
 IN72 556 OUT56 507
✓
FinQaAdbe2008NetGrossLiabilitywhat is the net change in the gross liability for unrecognized tax benefits during 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 196 OUT1 488
✓
FinQaAmt2012HardAssetsBrazilianhard assets were what percent of the brazilian purchase price , as finally determined?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 159 OUT2 802
✓
FinQaAon2010ConsiderationTransferredDedicated2what is portion of the total consideration transferred is dedicated to trademarks?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 922 OUT1 471
✓
FinQaAon2018IncreaseCompanyRecordedwhat was the percent of the increase in the company recorded a liability for interest and penalties from 2017 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 161 OUT1 392
×
FinQaC2018SharesGrantedwhat was the value of the shares granted1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 73.87, expected: 952671768.13 Values: difference = 952671694.26 tolerance = 9526717.6813
 Failed IN2 540 OUT1 877
✓
FinQaCb2010BalanceShortTermwhat is the percentage change in the balance of short-term investments in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 007 OUT2 144
✓
FinQaDre2005AfterTaxGainswhat was the ratio of the after tax gains of in 2004 compared to 2003 in dollars1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 445 OUT970
✓
FinQaDre2005GainSalesBeforewhat was the total gain on sales in 2004 before any adjustment for impairments in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 441 OUT1 622
✓
FinQaEtfc2012NetImpairmentwhat was the percentage change in the net impairment recognized from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 977 OUT1 604
✓
FinQaEtr2016NetRevenueEntergy2what is the net change in net revenue during 20016 for entergy mississippi , inc.?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 821 OUT1 533
✓
FinQaFis2016CashFlowsOperations2what was the percentage change in cash flows from operations from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 360 OUT1 378
✓
FinQaFis2016IncreaseCashFlowswhat is the percentage increase in cash flows from operations from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 360 OUT1 643
✓
FinQaGs2013DecemberFairSecuritieswhat was the average of the fair values of the securities and certain overnight cash deposits included in gce as of december 2013 and december 2012 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 075 OUT923
✓
FinQaGs2013FiveReturnIndexwhat is the five year total return on the s&p 500 index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 887 OUT1 800
×
FinQaHolx2008EstimatedPriceHologicwhat is the estimated price per share , in dollars , of hologic common stock used in the r2 acquisition?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 205500, expected: 23.35227 Values: difference = 205476.64773 tolerance = 0.2335227
 Failed IN2 130 OUT1 409
✓
FinQaHum2017AmortizationExpensewhat was the average amortization expense between 2015 and 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 412 OUT1 750
✓
FinQaHum2017AmortizationExpenseDuewhat percent of the total estimated amortization expense for 2018 through 2022 is expected in 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 418 OUT1 921
✓
FinQaIp2009ContractualObligationsFuture2what percentage of contractual obligations for future payments under existing debt and lease commitments and purchase obligations at december 31 , 2009 due in 2012 are maturities of long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 788 OUT1 555
✓
FinQaJpm2005IncreaseInterestRatesfor a 2% ( 2 % ) increase in interest rates , what would have been the total impact to earnings for 2005 and 2004 ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 277 OUT1 168
✓
FinQaMar2004CarryingFairNoteswhat is the difference of between the carrying amount and the fair value of notes and other long-term assets in 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 811 OUT1 571
✓
FinQaMmm2015InternationalQualifiedNonin 2016 what was the ratio of the us to the international qualified and non-qualified pension benefits1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 183 OUT1 592
✓
FinQaMro2003CrackSpreadValuesfor 2002 and 2003 , what is the average crack spread values?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 187 OUT1 318
✓
FinQaMro2008PipelineBarrelsHandled3what percentage of pipeline barrels handled consisted of crude oil trunk lines in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 183 OUT1 252
✓
FinQaMsi2008ConsolidatedNetSaleswhat percentage difference of consolidated net sales from 2006 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 542 OUT4 144
✓
FinQaMsi2012ExpectedVolatilityWeightedwhat was the average expected volatility of the weighted-average estimated fair value of employee stock options from 2010 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 483 OUT2 183
✓
FinQaPkg2002BalanceOptionsJanuarywhat is the total value of the balance of options as of january 1 , 2000 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 993 OUT1 454
✓
FinQaRsg2016ActualAssetAllocationbased on the 2016 actual asset allocation what was the debt to equity ratio1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 897 OUT1 382
✓
FinQaTfx2017NumberSecuritiesApproved2what portion of the total number of securities approved by security holders remains available for future issuance?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 617 OUT2 057
✓
FinQaUnp2009SatisfiedWillCustomershow satisfied will customers be in 2010 if the 2008 satisfaction index increase occurs again in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 428 OUT1 881
✓
FinQaUnp2011OperatingCashFlowfor 2011 , what percent of operating cash flow was distributed to shareholders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 261 OUT1 217
✓
FinQaUps2012CumulativeReturnInvestment2what was the difference in percentage total cumulative return on investment for united parcel service inc . versus the dow jones transportation average for the five years ended 12/31/2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 763 OUT2 328
✓
FinQaWrk2018BalanceFiscalGrosswhat was the percentage change in the balance at end of fiscal year for the gross unrecognized tax benefits1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 411 OUT2 182
✓
FinQaWrk2018BalanceTaxBenefitsby what percent did the balance of tax benefits increase between the beginning of 2016 and the end of 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 421 OUT1 496
Reasoning - FinQA annual report calculations (set 27) 33 passed
100.0%
 IN71 699 OUT52 053
✓
FinQaAes2002FutureMinimumLeasewhat percentage of total future minimum lease commitments is due in 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 025 OUT1 100
✓
FinQaAlle2015ConsideringReservesEnvironmentalconsidering the year 2015 , what is the percentage of reserves for environmental matters related to remediation of sites?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 308 OUT1 705
✓
FinQaAmt2006AggregateCarryingLongwhat fraction of the aggregate carrying value of long-term debt should be reported as a current liability as of december 31 , 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 214 OUT2 310
✓
FinQaAwk2013NetTaxPositionswhat was the net change in tax positions for 2012 , computed as increases in current period tax positions less decreases in prior period measurement of tax positions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 081 OUT1 111
✓
FinQaBkng2016MeasurementPointDecemberat the measurement point december 312016 what was the ratio of the the priceline group inc . . to the nasdaqcomposite index1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 558 OUT743
✓
FinQaCdns2018NetEffectCumulative2what is the percentage net effect of the cumulative effect adjustments , net of income tax effects , on the retained earnings balance as previously reported for december 30 , 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 093 OUT3 293
✓
FinQaDre2012ReductionSecondGenerationwhat was the percentage reduction second generation tenant improvements1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 947 OUT2 565
✓
FinQaDvn2018TaxExpensewhat was the ratio in the total tax expense from 2018 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 805 OUT1 690
✓
FinQaEtr2004NetRevenueEntergy2what is the net change in net revenue during 2004 for entergy louisiana?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 815 OUT1 455
✓
FinQaFis2016ReturnInvestedSoldwhat is the gain , in dollars , if $ 100000 is invested in the s&p 500 in 12/11 and sold in 12/16?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 698 OUT962
✓
FinQaGis2017OffBalanceSheetwhat is the total amount of guarantees and comfort letters issued as of may 28 , 2017 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 749 OUT893
✓
FinQaGs2012MaximumCollateralPostedin millions for 2012 2011 , what was maximum collateral posted?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 279 OUT491
✓
FinQaGs2014OtherLiabilitiesAccrued2what percentage of total other liabilities and accrued expenses in 2013 are due to compensation and benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 196 OUT1 767
✓
FinQaHolx2007IssuedSecuritiesApproved2what portion of the issued securities is approved by security holders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 121 OUT1 904
✓
FinQaIlmn2008SharesExercisedwhat is the total exercise value , in dollars , of the outstanding warrants expiring in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 251 OUT1 349
✓
FinQaIp2006ContractualObligationsFuture2what percentage of contractual obligations for future payments under existing debt and lease commitments and purchase obligations at december 31 , 2006 due in 2008 is attributable to total debt repayments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 702 OUT1 485
✓
FinQaIpg2017ContingentAcquisitionPayments2what portion of the total contingent acquisition payments is due in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 221 OUT1 658
✓
FinQaJpm2010JpmorganChaseIncomewhat was the percent of the jpmorgan chase income before income tax expense/ ( benefit ) and extraordinary gain that was us sourced1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 556 OUT1 437
✓
FinQaJpm2015InterestDerivativesMadeinterest rate derivatives made up how much of the net total derivatives for 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 463 OUT2 751
✓
FinQaJpm2015NetCashCollateralin 2007 what was the percent of the total net of cash collateral from credit derivatives1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 464 OUT1 390
✓
FinQaKhc2018JulyAugustDebtin july and august 2018 , what percent of the debt carrying value at december 30 , 2017 did they pay off?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 248 OUT1 099
✓
FinQaMar2018ContractualObligationsOffof the total contractual obligations and off-balance sheet arrangements contractual obligations what percentage is due to operating leases where we are the primary obligor?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 579 OUT1 233
✓
FinQaMas2017CumulativeShareholderReturnwhat was the percentage cumulative total shareholder return on masco common stock for the five year period ended 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 831 OUT1 341
✓
FinQaMrk2013ReconciliationUnrecognizedTaxbased on the reconciliation what was the percent of the change in the unrecognized tax benefits from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 500 OUT1 701
✓
FinQaMro2013PriceWtiCrude2by what percentage did the average price of wti crude oil increase from 2011 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 361 OUT1 927
✓
FinQaRcl2016AnticipatedIncreaseGlobalwhat was the anticipated percentage increase in the global cruise fleet berths from 2017 to 20211 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 967 OUT2 222
✓
FinQaRsg2010SeniorNotesMarchwhat was the ratio of the 5.000% ( 5.000 % ) to 6.200% ( 6.200 % ) the senior notes in march 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 477 OUT1 805
✓
FinQaSna2013ReturnInvestmentInvestedwhat is the return on investment if $ 100 are invested in snap-on at the end of 2008 and sold at the end of 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 816 OUT1 437
✓
FinQaSna2013ReturnInvestmentInvested2what is the return on investment if $ 100 are invested in s&p500 at the end of 2008 and sold at the end of 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 819 OUT1 229
✓
FinQaStt2014RoiInvestmentStatewhat is the roi of an investment in state street corporation from 20011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 446 OUT2 059
✓
FinQaUnp2011PlannedCapitalExpendituresin 2012 , are the planned capital expenditures greater than free cash flow in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 267 OUT1 486
✓
FinQaUnp2015NetworkRouteMileswhat is the percent of the network route in miles that is not leased but owned by the company1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 204 OUT1 079
✓
FinQaZbh2015ExpenseNetTax2what was the change in total expense net of tax for share based compensation from 2013 to 2014 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 638 OUT1 376
Reasoning - FinQA annual report calculations (set 28) 33 passed
100.0%
 IN73 941 OUT50 220
✓
FinQaAes2001ScheduledMaturitiesDebt3what percentage of scheduled maturities of total debt are due after 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 233 OUT1 847
✓
FinQaAmt2003InterestRedeemedNoteswhat was the interest rate on the redeemed 6.25 notes in 20041 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 580 OUT1 098
✓
FinQaAmt2006NetBalanceEmployee2what is the net change in the balance of employee separations liability during 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 471 OUT1 911
✓
FinQaAmt2007GrowthPriceShares2what is the growth rate in the price of shares purchased by employees from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 686 OUT1 158
✓
FinQaAmt2007PricingModelWeightedbased on the the pricing model what was the percentage change in the weighted average risk-free interest rate from 2005 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 691 OUT2 326
✓
FinQaAwk2018PriceShareAwk2at what price per share did awk repurchase its shares of common stock in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 702 OUT1 490
✓
FinQaBdx2018LossesDebtExtinguishmentwhat was the percentage change in the losses on debt extinguishment from 2017 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 130 OUT2 151
✓
FinQaBkr2017CashHeldBehalfwhat is the cash held on behalf of ge as a percentage of cash and equivalents in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 266 OUT1 312
✓
FinQaC2008PretaxGainsSalewhat was the total pretax gains in millions for the sale so mastercard shares from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 378 OUT1 789
✓
FinQaC2009NonPensionPlansin 2010 what was the ratio of the non-us pension plans , discretionary contributions to the postretirement benefit plans1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 169 OUT820
✓
FinQaCdns2018NetEffectAdoptionwhat is the net effect of the adoption of new accounting standards?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 057 OUT1 783
✓
FinQaCe2016ResearchDevelopmentThroughwhat is the total research and development for the year 2014 through 2016 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 148 OUT1 295
✓
FinQaEtr2016ExpectedPaymentsBonds2what is the total expected payments on the bonds for the next 5 years for entergy new orleans storm recovery funding?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 314 OUT1 790
✓
FinQaEtr2016RelatingTexasSecuritizationrelating to the texas securitization bonds , what were the total amounts ( millions ) of the issuance when considering the transaction costs and the related deferred income tax benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 322 OUT1 503
✓
FinQaGrmn2008IncreaseUnrecognizedTaxwhat was the increase in the unrecognized tax benefits observed during 2007 and 2008 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 278 OUT1 872
✓
FinQaGs2012FinancialLiabilitiesFairwhat is the percentage change in total financial liabilities at fair value in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 200 OUT1 474
✓
FinQaIntc2015FacilitiesMeasuredSquare2what percentage of total facilities as measured in square feet are owned?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 988 OUT894
✓
FinQaJkhy2017JkhyReturnPeerjkhy's total 5 year return was what percent of the peer group?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 777 OUT1 416
✓
FinQaJpm2009ExcludingDerivativesNet2excluding derivatives , what are net 2008 trading assets , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 797 OUT1 193
✓
FinQaJpm2015WithoutForeignExchangewithout the foreign exchange hedges , what would the total net derivatives be , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 475 OUT1 583
✓
FinQaK2006NetCashProvidedwhat percent of net cash provided by operations is retained as cashflow in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 611 OUT1 846
✓
FinQaLkq2016RentalExpenseOperating2what was the percentage change in rental expense for operating leases from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 891 OUT1 934
✓
FinQaLmt2016GrowthNetSaleswhat is the growth rate of net sales from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 443 OUT1 271
✓
FinQaMar2004CarryingFairLongwhat is the difference of between the carrying amount and the fair value of long-term debt and other long-term liabilities in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 824 OUT1 470
✓
FinQaMro2003NaturalGasOptionsfor natural gas options in place to manage the price risk , what is the change in the percentage of the anticipated natural gas purchases hedged between the first quarter of 2004 and the second quarter of 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 214 OUT1 330
✓
FinQaNclh2018NetInterestExpensewhat is the percentage change in net interest expense in 2018 compare to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 217 OUT1 250
✓
FinQaPkg2005PurchaseCommitmentsEnergy2what percentage of total purchase commitments for energy are currently in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 994 OUT1 193
✓
FinQaPnc2014TaxCreditInvestmentsfor tax credit investments included in our equity investments held by consolidated partnerships , what was the change in billions between december 31 , 2014 and december 31 , 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 281 OUT1 651
✓
FinQaSlb2015ShareUnderNewwhat was the percent of the share under this new share repurchase program as of december 3120151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 374 OUT1 512
✓
FinQaStt2007BalanceCashGovernmentwhat is the percentage change in the the balance of cash and u.s . government securities from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 121 OUT1 740
✓
FinQaUnp2016OperatingRevenueChemicalin 2015 what was the percent of the total operating revenue that was from chemical freight1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 205 OUT1 558
✓
FinQaV2008SeptemberVolumeSupportin september 2008 what was the percent of the total volume and support incentives that was due in 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 931 OUT1 448
✓
FinQaVrtx2006DepreciationAmortizationExpensewhat was the percent change in depreciation and amortization expense between 2004 and 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 173 OUT1 312
Reasoning - FinQA annual report calculations (set 29) 33 passed
100.0%
 IN79 315 OUT50 046
✓
FinQaAapl2003ExcludingAccretionEndingexcluding accretion , what was the ending balance of asset retirement liability as of september 27 2003 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 376 OUT1 559
✓
FinQaAbmd2006ObligationsOperatingLeasewhat percentage of total obligations are operating lease obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 189 OUT1 496
✓
FinQaAbmd2008BalanceUnrecognizedTaxwhat is the percentage change in the balance of unrecognized tax benefits from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 333 OUT1 509
✓
FinQaAbmd2012IncreaseBaseRentwhat is the percentage increase in base rent for danvers , massachusetts facility from the period 2008-2010 to 2010 - 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 340 OUT1 200
✓
FinQaAdi2010TableWouldAnnualbased on the table , what would be the annual percent return for the companies investments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 099 OUT1 772
✓
FinQaAlxn2016FacilityLeaseObligationswhat is the percentage change in total facility lease obligations from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 413 OUT901
✓
FinQaAnss2012RangeUnitedStateswhat is the range , in thousands , for united states' revenue from 2010-2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 430 OUT1 588
✓
FinQaAnss2016ProportionGlobalHeadquarterswhat is the proportion of total global headquarters leases to total other operating leases?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 038 OUT1 342
✓
FinQaBlk2012GrowthBalanceEquitywhat is the growth rate in the balance of equity during 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 473 OUT1 891
✓
FinQaBlk2012GrowthBalanceLongwhat is the growth rate in the balance of long-term debt during 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 475 OUT2 345
✓
FinQaBlk2014GrowthRentExpensewhat is the growth rate in rent expense and certain office equipment expense from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 879 OUT1 533
✓
FinQaBlk2014GrowthRentExpense2what is the growth rate in rent expense and certain office equipment expense from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 879 OUT1 288
✓
FinQaBll2010CashFlowsProvided2what was the percentage change in cash flows provided by ( used in ) operating activities including discontinued operations between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 168 OUT1 927
✓
FinQaD2002GrowthRentalExpensewhat is the growth rate in rental expense included in other operations and maintenance expense in 2002 compare to 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 789 OUT1 719
✓
FinQaD2002GrowthRentalExpense2what is the growth rate in rental expense included in other operations and maintenance expense in 2001 compare to 2000?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 789 OUT1 611
✓
FinQaGs2013CollateralPostedwhat was the percentage change in collateral posted from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 172 OUT1 260
✓
FinQaHolx2009FairGrantMoneybased on the fair value of the grant , how much money did the company lose when some of their grants were forfeited .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 177 OUT1 849
✓
FinQaIp2006CapitalSpendingContinuing3in 2005 what was the percent of the total capital spending from continuing operations by each of our business segments for printing papers1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 532 OUT1 570
✓
FinQaIp2006IncreaseCashWorkingwhat was the difference in the increase in the cash in working capital in 2006 compared with the increase in 2005 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 536 OUT1 035
✓
FinQaIp2009DecemberFutureMinimumat december 31 , 2009 , total future minimum commitments under existing non-cancelable leases and purchase obligations what was the percent of the lease obligations compared to the purchase obligations in 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 726 OUT1 793
✓
FinQaIp2009SumTemporaryDifferenceswhat was the sum of the temporary differences between 2007 and 2009 in billions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 704 OUT2 060
✓
FinQaJkhy2019ReturnJkhywhat was the 5 year total return for jkhy?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 030 OUT1 671
✓
FinQaLmt2014WeightedCommonShares2what was the change in millions of the weighted average common shares outstanding for diluted computations from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 219 OUT1 316
✓
FinQaMo2016RoiInvestmentAltriawhat is the roi of an investment in altria group inc . from december 2011 to december 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 095 OUT1 839
✓
FinQaNclh2018FutureCommitmentsServicewhat percentage of future commitments for service , maintenance and other business enhancement capital expenditure contracts are due in the 1-3 years period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 656 OUT1 396
✓
FinQaPpg2006ReserveProductWarrantieswhat was the percentage change in the reserve for product warranties from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 735 OUT887
✓
FinQaPpg2018ReservesEnvironmentalContingencieswhat percent of total reserves for environmental contingencies are related to glass and chemical in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 391 OUT959
✓
FinQaPpg2018ReservesEnvironmentalContingencies2what percent of total reserves for environmental contingencies are related to new jersey chrome in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 391 OUT685
✓
FinQaUnp2011Equitywhat was the change in millions of average equity from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 455 OUT1 027
✓
FinQaUnp2015FreightRevenuesIntermodalwhat percentage of total freight revenues was the intermodal commodity group in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 204 OUT2 387
✓
FinQaUnp2016OperatingRevenuesRevenuewhat percentage of total operating revenues from 2014-2016 is the revenue from coal?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 208 OUT2 426
✓
FinQaUnp2018MinimumCapitalLeaseswhat percent of total minimum capital leases payments are due in 2021?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 207 OUT1 452
✓
FinQaUnp2018MinimumCapitalLeases2what percent of total minimum capital leases payments are due in 2020?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 207 OUT753
Reasoning - FinQA annual report calculations (set 3) 32 passed1 failed
97.0%
 IN70 824 OUT47 677
✓
FinQaAapl2006CountingIndirectSharescounting indirect shares , how many shares would arthur d . levinson own in total?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 294 OUT833
✓
FinQaAmt2012PurchaseDecemberJanuarywhat was the ratio of the purchase in december 2012 to the purchase in january 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 981 OUT1 550
✓
FinQaAon2010ConsiderationTransferredDedicatedwhat is portion of the total consideration transferred is dedicated to goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 922 OUT1 399
✓
FinQaApd2016ConsideringOperatingIncomeconsidering the years 2014-2016 , what is the average operating income?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 215 OUT1 615
✓
FinQaAwk2012CompanyGrossLiabilitieswhat percentage of the company's gross liabilities are classified as other long-term liabilities in the accompanying consolidated balance sheets in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 041 OUT1 650
✓
FinQaAwk2013AwkUnrecognizedTaxwhat is awk's 2012 unrecognized tax benefit as a percentage of gross liabilities?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 108 OUT1 999
✓
FinQaBll2012FiveReturnEndingthe five year total return for the period ending 12/31/2012 on ball corporation stock was how much greater than the same return on the s&p 500?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 670 OUT1 977
✓
FinQaBll2012FiveReturnEnding2the five year total return for the period ending 12/31/2012 on ball corporation stock was how much greater than the same return on the dj us containers & packaging index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 670 OUT2 325
✓
FinQaC2009NetInterestRevenue2what percent of net interest revenue where total operating expenses in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 920 OUT1 034
✓
FinQaCb2010FairFinancialMarketwhat is the change in fair value of financial market instruments as part of the hedging strategy during 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 361 OUT1 512
✓
FinQaCdns2015ReturnCadenceDesignwhat is the rate of return in cadence design systems inc . of an investment from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 832 OUT767
✓
FinQaCdns2018NetEffectCumulativewhat is the net effect of the cumulative effect adjustments , net of income tax effects , to beginning retained earnings for new accounting standards adopted by cadence on the retained earnings balance as adjusted for december 30 , 2017 , in thousands?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 095 OUT1 697
✓
FinQaCme2010EstimatedRevolvingCreditwhat is the estimated percentage of revolving credit facility in relation with the total senior credit facility in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 400 OUT2 133
✓
FinQaCme2010OutstandingOptionsPlanswhat percentage of the outstanding options were from plans approved by security holders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 834 OUT880
✓
FinQaDisca2014CumulativeShareholderReturnwhat was the percentage cumulative total shareholder return on disca common stock for the five year period ended december 31 , 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 192 OUT1 538
✓
FinQaEcl2016CreditLinesHaswhat is the amount of credit lines that has been drawn in millions as of year-end 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 479 OUT906
✓
FinQaEog2018ConsideringEndingBalanceconsidering the years 2016-2018 , what is the average ending balance for valuation allowances for deferred income tax assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 252 OUT1 011
✓
FinQaEtr2011DecreaseReceivablesMoneywhat is the percentage decrease in receivables from the money pool from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 342 OUT2 025
✓
FinQaGpn2010FairNonVestedwhat is the percentage change in the total fair value of non-vested shares from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 168 OUT2 636
✓
FinQaGpn2013LeasePaymentsWillwhat percentage of lease payments will be paid out in the first year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 893 OUT1 630
✓
FinQaGs2015FutureMinimumRental2what percentage of future minimum rental payments are due after 2020?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 280 OUT1 520
✓
FinQaGs2017FourthQuartersTierin millions for the fourth quarters of 2017 and 2016 , what was the total tier 1 capital?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 333 OUT1 262
✓
FinQaHum2014StockPricePerformancewhat was the percent of the change in the stock price performance for hum from 2010 to 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 618 OUT843
✓
FinQaIp2006BrazilianPaperSalesbrazilian paper sales represented what percentage of printing papers in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 802 OUT1 487
✓
FinQaL2009ReturnInvestmentwhat is the return on investment for s&p500 from 2004 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 853 OUT908
✓
FinQaMro2004NumberSharesPurchasedwhat percentage of total number of shares purchased were repurchased in open-market transactions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 238 OUT1 697
×
FinQaMro2007DecemberUnrecognizedCompensationas of december 31 , 2007 , how much unrecognized compensation cost related to restricted stock awards is expected to be recognized in 1 year , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 37, expected: 26.42857 Values: difference = 10.57143 tolerance = 0.2642857
 Failed IN2 603 OUT1 427
✓
FinQaMro2008MilesPrivateCrudewhat was total miles of private crude oil pipelines and private refined products pipelines?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 179 OUT481
✓
FinQaPm2017PreTaxPensionwhat is the percentage change in the pre-tax pension and postretirement expense from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 449 OUT1 695
✓
FinQaRsg2018DecemberDeclineAllowanceas of december 31 , 2018 what was the percentage decline in the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 005 OUT1 698
✓
FinQaStt2009MoreNetGainsby how much more is the net gains from sales of available-for-sale securities in 2009 compare to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 457 OUT1 483
✓
FinQaUps2012RoiInvestmentUpswhat is the roi of an investment in ups from 2008 to 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 744 OUT1 296
✓
FinQaVno2014FiveVornadoRealtywhat was the five year change in the vornado realty trust index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 594 OUT763
Reasoning - FinQA annual report calculations (set 30) 33 passed
100.0%
 IN79 101 OUT55 193
✓
FinQaAbmd2005RiskFreewhat is the percentage change in the risk-free rate from 2003 to 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 204 OUT2 011
✓
FinQaAbmd2005RiskFree2what is the percentage change in the risk-free rate from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 204 OUT1 606
✓
FinQaAbmd2007GrowthWeightedFairwhat is the growth rate in the weighted average fair value for options granted between 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 512 OUT1 678
✓
FinQaAbmd2012IncreaseBaseRent2what is the percentage increase in base rent for danvers , massachusetts facility from the period 2010-2014 to 2014-2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 339 OUT1 728
✓
FinQaAbmd2012RoiInvestmentAbiomedwhat is the roi of an investment in abiomed inc from march 2007 to march 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 760 OUT1 380
✓
FinQaAdi2019BoardDirectorsIncreasein 2008 , how much percent did the board of directors increase the share repurchase program .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 029 OUT2 465
✓
FinQaAdi2019MoneyCompanyPayhow much money did the company pay for the repurchase of shares on non-announced plans or programs?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 029 OUT2 375
✓
FinQaAlxn2016OutstandingTermLoanwhat portion of total outstanding term loan is due in the next 12 months as of december 31 , 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 432 OUT2 678
✓
FinQaAnss2012IncurredLeaseRentalwhat is the total amount incurred , in millions , from lease rental expenses related to the company's executive offices from 2010-2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 438 OUT1 690
✓
FinQaBdx2018RangeLossesUndesignatedwhat is the range of losses on undesignated foreign exchange derivatives , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 128 OUT1 573
✓
FinQaBkr2017NetCashwhat is the net change in cash during 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 257 OUT1 647
✓
FinQaBlk2012LongTermBorrowingswhat portion of the total long-term borrowings is due in the next 24 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 434 OUT2 488
✓
FinQaBlk2015FutureMinimumCommitmentswhat portion of the total future minimum commitments under operating leases is due in the next 36 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 749 OUT1 856
✓
FinQaBlk2017CarryingCompanyInterestwhat is the percentage change in the carrying value of company's interest in pennymac from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 054 OUT2 011
✓
FinQaHolx2009PurchaseCashwhat percent of the purchase was in cash?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 041 OUT943
✓
FinQaIp2006CumulativeRentExpensewhat was the cumulative rent expense from 2004 to 2006 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 592 OUT748
✓
FinQaIp2006DebtAssociatedLeasewhat was the ratio of the 2007 lease obligations related to discontinued operations and businesses held for sale to the 2007 total debt payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 686 OUT2 298
✓
FinQaIp2006IndustrialPackagingProfitwhat was the industrial packaging profit margin in 20041 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 572 OUT1 840
✓
FinQaIp2006ProfitMarginPrintingwhat was the profit margin of printing papers in 20051 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 799 OUT1 544
✓
FinQaIp2009ConsideringPercentualIncreaseconsidering the years 2010-2011 , what is the percentual increase observed in the maturities of long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 775 OUT1 837
✓
FinQaIp2009ConsideringVariationObservedconsidering the years 2011-2012 , what is the variation observed in the lease obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 769 OUT1 425
✓
FinQaMo2014GrowthNetEarningswhat is the growth rate in net earnings attributable to altria group inc . from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 902 OUT963
✓
FinQaMo2016RoiInvestmentDecemberwhat is the roi of an investment in s&p500 from december 2011 to december 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 095 OUT922
✓
FinQaNclh2018InterestLiborhow much did interest with libor change from year 1 to years 3-5?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 648 OUT2 055
✓
FinQaPpg2006ReserveProductWarranties2what was the change in millions in the reserve for product warranties from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 736 OUT1 258
✓
FinQaPpg2008NetAccruedLiabilitywhat was the net change in the accrued liability for unrecognized tax benefits from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 427 OUT1 566
✓
FinQaPpg2012CapitalSpendingRelatedwhat was the difference in millions of capital spending related to business acquisitions from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 045 OUT1 413
✓
FinQaTfx2015WouldRestructuringChargeswhat would the total restructuring charges be without including prior years of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 241 OUT2 244
✓
FinQaTfx2017RemainingSecuritiesWouldif the remaining securities would be use or exercised at $ 113.49 , what would cost be for the company?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 626 OUT2 581
✓
FinQaUnp2007FreeCashFlowwhat was change in millions of free cash flow from 2005 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 236 OUT1 074
✓
FinQaUnp2007FreeCashFlow2what was change in millions of free cash flow from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 236 OUT971
✓
FinQaUnp2010HadAllFourhad all four quarters of 2010 had the same number of total shares purchased , how many total shares were purchased in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 902 OUT1 349
✓
FinQaUnp2015FreightRevenuesIntermodal2what percentage of total freight revenues was the intermodal commodity group in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 204 OUT976
Reasoning - FinQA annual report calculations (set 31) 33 passed
100.0%
 IN76 895 OUT48 194
✓
FinQaAbmd2006ObligationsOperatingLease2what percentage of total obligations are operating lease obligations in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 195 OUT884
✓
FinQaAbmd2007GrowthWeightedFair2what is the growth rate in the weighted average fair value for options granted between 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 512 OUT1 340
✓
FinQaAbmd2008ExpectedContingentPaymentswhat is the total expected contingent payments to impella 2019s former shareholders upon fda approval of impella devices , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 338 OUT2 125
✓
FinQaAbmd2012RoiInvestmentNasdaqwhat is the roi of an investment in nasdaq composite index from march 2007 to march 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 761 OUT1 531
✓
FinQaBdx2018OtherIncomewhat is the average of total other income from 2016-2018 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 129 OUT1 534
✓
FinQaBkr2017NetCash2what is the net change in cash during 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 257 OUT2 127
✓
FinQaBlk2012LongTermBorrowings2what portion of the total long-term borrowings is due in the next 36 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 434 OUT2 172
✓
FinQaBlk2015AnnualInterestExpensewhat is the annual interest expense related to 201c2019 notes 201d , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 755 OUT743
✓
FinQaBlk2017FairCompanyInterestwhat is the percentage change in the fair value of company's interest in pennymac from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 054 OUT1 847
✓
FinQaCmcsa2008CapitalExpendituresIncurredwhat was the percent of the capital expenditures we incurred in our cable segment in 2006 for the customer premise equipment1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 300 OUT2 123
✓
FinQaCmcsa2015CapitalExpendituresIncurredwhat was the percentage of the capital expenditures incurred in our cable communications for customer premise equipment in 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 074 OUT902
✓
FinQaCmcsa2015NolCarryForwardin 2015 what was the ratio of the nol carry forward for the federal to the foreign taxes1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 280 OUT1 556
✓
FinQaCmcsa2015ReviewReconciliationUnrecognizedbased on the review of the reconciliation of unrecognized tax benefits what was the change in 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 279 OUT2 192
✓
FinQaIp2006DebtComparedLeasein 2007 what was the percent of total debt in the total contractual obligations for future payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 681 OUT980
✓
FinQaIp2006FutureMinimumCommitmentswhat was the percentage of total future minimum commitments under existing non-cancelable leases and purchase obligations associated with purchase obligations in 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 600 OUT1 551
✓
FinQaLkq2016CumulativeRentalExpensewhat was the cumulative rental expense from 2014 to 2016 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 887 OUT806
✓
FinQaLkq2016FutureMinimumLeasein 2016 what was the percent of the total future minimum lease commitments due in 20191 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 891 OUT873
✓
FinQaMo2014GrowthNetEarnings2what is the growth rate in net earnings attributable to altria group inc . from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 902 OUT1 481
✓
FinQaMo2014SmokelessProductsShipmentswhat portion of total smokeless products shipments are related to copenhagen segment during 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 931 OUT1 842
✓
FinQaMo2014SmokelessProductsShipments2what portion of total smokeless products shipments are related to copenhagen segment during 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 931 OUT1 675
✓
FinQaNclh2018LongTermDebtwhat percent of long-term debt was paid off in 2021?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 210 OUT1 840
✓
FinQaPpg2008NetAccruedLiability2what was the percentage net change in the accrued liability for unrecognized tax benefits from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 428 OUT1 616
✓
FinQaPpg2012CapitalSpendingRelated2what was the difference in millions of capital spending related to business acquisitions from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 045 OUT908
✓
FinQaUnp2006RouteMilesMainwhat percent of total route miles are main line in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 066 OUT1 656
✓
FinQaUnp2006RouteMilesMain2what percent of total route miles are main line in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 062 OUT1 693
✓
FinQaUnp2009MaterialObligationsCommitmentswhat percent of total material obligations and commitments as of december 31 , 2009 are operating leases?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 318 OUT1 131
✓
FinQaUnp2009MaterialObligationsCommitments2what percent of total material obligations and commitments as of december 31 , 2009 are capital leases?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 318 OUT1 384
✓
FinQaUnp2010MoreSpentShareshow much more was spent on shares in nov 2010 than dec 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 892 OUT2 196
✓
FinQaUnp2011Equity2what was the change in millions of average equity from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 455 OUT817
✓
FinQaUnp2011FreeCashFlowwhat was the percentage change in free cash flow from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 265 OUT1 337
✓
FinQaUnp2011FreeCashFlow2what was the percentage change in free cash flow from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 265 OUT1 117
✓
FinQaUnp2016MathematicalRangeChemicalwhat is the mathematical range for chemical revenue from 2014-2016 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 208 OUT1 286
✓
FinQaVrtx2006PropertyEquipmentNetwhat was the ratio of the total property and equipment net in 2006 to 20051 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 172 OUT929
Reasoning - FinQA annual report calculations (set 32) 32 passed1 failed
97.0%
 IN74 503 OUT60 511
✓
FinQaAal2010PensionRetireeMedicalfrom 2016-2020 what was the ratio of the pension to the retiree medical and other service costs1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 986 OUT1 846
✓
FinQaAes2002DecreaseRentalExpensewhat was the decrease in rental expense ( millions ) for operating leases from 2001 to 2002?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 034 OUT2 134
✓
FinQaAmat2013ReturnInvestedSoldwhat is the gain , in dollars , if $ 100000 is invested in the s&p 500 index in 2008 and sold in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 070 OUT2 087
✓
FinQaAmt2006EmployeeLiabilitySeparationsin 2004 what was the percent of the change in the employee liability for employee separations1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 472 OUT2 045
✓
FinQaAmt2007WoburnPropertyOwnedwhat portion of the woburn property owned by the american tower corporation is subleased?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 996 OUT2 233
✓
FinQaAmt2012PursuantAgreementMarchpursuant to the agreement , on march 30 , 2012 , what was the approximate price for each site the company purchased in thousands1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 173 OUT1 578
✓
FinQaAon2015AggregateIntrinsicStockwhat was the average aggregate intrinsic value of stock options exercised from 2013 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 089 OUT616
✓
FinQaAon2015NumberSharesIssuedwhat was the average number of shares issued to employees under the u.s . employee share purchase plan from 2013 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 097 OUT2 294
✓
FinQaBlk2014FutureNotesDuewhat percent of future minimum operating lease commitments are due by 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 867 OUT2 288
✓
FinQaCme2010IncreaseCashDuewhat was the ratio of the new issuances of debt in 2008 to the net debt reductions in debt instruments in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 405 OUT2 725
✓
FinQaCme2010ReceivablesBrokersOtherwhat was the percentage change in receivables from brokers with in other current assets from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 038 OUT1 533
✓
FinQaCme2017AnualizedReturnwhat is the anualized return for s&p 500 from 2012 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 754 OUT2 058
✓
FinQaEcl2016CashEquivalentsHandwhat fraction of cash and cash equivalents on hand was held in the u.s . as of december 31 , 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 485 OUT924
✓
FinQaGis2019SalesGrowthwhat is the sales growth rate from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 153 OUT1 768
✓
FinQaHolx2009PurchaseShareHologicduring the purchase , what was the per share value of the hologic common stock1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 048 OUT1 159
✓
FinQaHwm2017AnnualizedReturnAematerialswhat is the annualized return for the s&p 500 aematerials index during 2012 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 853 OUT2 038
✓
FinQaIlmn2008SharePriceWarrantsduring 2008 what was the average cash proceeds per warrant exercised , in dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 245 OUT1 573
×
FinQaIp2006SumEuropeanPaperswhat was the sum of the european papers net sales from 2004 to 2006 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 4400, expected: 4.4 Values: difference = 4395.6 tolerance = 0.044000000000000004
 Failed IN2 807 OUT2 176
✓
FinQaIpg2017DecreaseContingentAcquisitionwhat is the percentage decrease in total contingent acquisition payments from 2018-2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 225 OUT1 761
✓
FinQaJpm2010WholesaleCreditExposurewhat was the percentage change in total wholesale credit exposure from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 492 OUT1 545
✓
FinQaL2009GrowthIndexDecemberwhat was the growth rate of the s&p 500 index from december 31 , 2004 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 859 OUT905
✓
FinQaLmt2014AggregateNotionalOutstandingin 2014 what was the ratio of the aggregate notional amount of outstanding interest rate swaps to the outstanding foreign currency hedges1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 218 OUT1 503
✓
FinQaMar2018ContractualObligationsOff2of the total contractual obligations and off-balance sheet arrangements contractual obligations what percentage is due to capital lease obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 573 OUT1 271
✓
FinQaMas2017CumulativeShareholderReturn2what was the difference in percentage cumulative total shareholder return on masco common stock versus the s&p 500 index for the five year period ended 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 842 OUT2 349
✓
FinQaMsi2014ExpectedVolatilitywhat is the percent change in expected volatility between 2012 and 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 689 OUT1 592
✓
FinQaMsi2014WeightedEstimatedFairwhat was the percentage change in the weighted-average estimated fair value of employee stock options granted during from 2013 to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 698 OUT2 027
✓
FinQaPnc2012AssetsEndedDechow many total assets were there at year ended dec 31 , 2011 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 451 OUT2 660
✓
FinQaSna2007CashDividendsPaidwhat was the percentage change in the cash dividends paid per common share from 2006 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 598 OUT1 670
✓
FinQaSna2007MinorityInterestwhat was the percentage increase in the minority interests deduction from 2005 to 20061 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 500 OUT3 185
✓
FinQaSna2012FairNonVestedwhat is the total fair value of the non-vested performance awards at beginning of year , ( in thousands ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 343 OUT1 315
✓
FinQaStt2009AggregateNetAsset2what was the percent change in the aggregate net asset values of the collateral pools underlying ssga lending funds between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 908 OUT1 390
✓
FinQaStt2009NetUnrealizedLosswhat was the percent change in net unrealized loss on available-for-sale securities between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 456 OUT2 573
✓
FinQaV2014IncreaseFairOptionwhat is the percentage increase in the fair value of option granted from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 079 OUT1 690
Reasoning - FinQA annual report calculations (set 33) 30 passed1 failed2 broken
90.9%
 IN73 186 OUT94 102
✓
FinQaAal2010DecreaseMinimumContributionwhat is the percentage decrease in the minimum contribution to benefit pension plans due to the relied act?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 978 OUT1 553
✓
FinQaAbmd2005AssumingSameGrowthassuming the same rate of growth as in 2005 , what would the projected risk free interest rate be in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 211 OUT2 855
✓
FinQaAes2001PriorFirstRemarketingprior to the first remarketing date , what is the annual interest cost on the remarketable or redeemable securities ( 2018 2018roars 2019 2019 ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 264 OUT1 777
✓
FinQaAmt2010OutstandingAmountsUnderwhat percentage of outstanding amounts under the company 2019s long-term financing arrangements is current in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 337 OUT2 122
✓
FinQaAmt2014WouldContingentConsiderationwhat would 2014 contingent consideration be without the foreign currency translation adjustment , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 189 OUT1 505
✓
FinQaAnet2015DecemberPurchaseCommitmentsas of december 31 , 2015 , are purchase commitments greater than expected 2016 lease commitments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 972 OUT1 744
✓
FinQaAwk2018CompanyRepurchasedSharesthe company repurchased how many million shares of common stock in the open market for the years ended december 31 , 2018 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 717 OUT1 330
✓
FinQaBlk2017UnamortizedDiscountDebtwhat percent does the unamortized discount and debt issuance costs reduce the carrying amount by?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 043 OUT3 307
✓
FinQaBll2006CurrentAssetsNetcurrent assets were what percent of net assets acquired for the can and alcan transactions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 024 OUT2 754
✓
FinQaBll2010ProductivityPlasticsBusinessproductivity in the plastics business measured by million $ sales per employee was what in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 314 OUT1 628
✓
FinQaCe2016ResearchDevelopmentCostswhat was the percentage change in the the research and development costs from 2014 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 149 OUT882
✓
FinQaDre2008BasicNetIncomewhat was the average basic net income available for common shareholders from 2006 to 2008 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 325 OUT1 326
✓
FinQaDre2008NetIncomeCommon2what is the net income per common share in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 315 OUT2 020
✓
FinQaFis2012ImpactEuroEarnings2what was the percentage change in the impact of the euro on earnings from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 637 OUT2 138
✓
FinQaGpn2013ExpectedMinimumPaymentswhat is the percentage change in the expected minimum payments from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 902 OUT1 432
✓
FinQaGs2012RiskWeightedAssets2what was the percentage change in risk-weighted assets at gs bank usa between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 487 OUT1 844
!
FinQaGs2015SecuritiesPurchasedUnderwhat was the percentage change in securities purchased under agreements to resell between 2014 and 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
AI output broken (model loop aborted)
 Broken IN2 219 OUT19 537
✓
FinQaHig2011ReinsuranceAccountswhat was the percentage change in the increase in net asbestos reserves from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 218 OUT1 272
✓
FinQaIntc2013IncreaseDowJoneswhat was the percent of the increase in the dow jones u.s . technology index from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 649 OUT895
✓
FinQaIp2006BrazilianPaperSales2brazilian paper sales represented what percentage of printing papers in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 802 OUT2 033
✓
FinQaJkhy2019GrowthCumulativeReturnwhat was the percentage growth of the 5 year- cumulative total return for the 2018 peer group from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 052 OUT961
✓
FinQaJpm2010LoansRetainedwhat was the percentage change in loans retained from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 490 OUT1 809
✓
FinQaJpm2014LoansRetainedwhat was the percentage change in loans retained from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 469 OUT1 675
✓
FinQaK2013SgaDueProjectwhat percent of 2013 reported sga is due to project k?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 841 OUT2 712
!
FinQaLmt2015NetEarningsContinuingwhat was the percentage change in net earnings from continuing operations from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
AI output broken (model loop aborted)
 Broken IN2 328 OUT19 010
✓
FinQaPnc2012PrivateInvestorRepurchasehow many total private investor repurchase claims were there in 2011 and 2012 combined , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 950 OUT1 634
✓
FinQaPpg2018EnvironmentalReservesGreaterare the 2018 environmental reserves greater than asbestos-related claim reserves?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 385 OUT653
✓
FinQaRl2008FactoryRetailStores2what percentage of factory retail stores as of march 29 , 2008 where located in japan?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 089 OUT1 032
✓
FinQaRsg2015AccountBalancein 2015 what was the the percentage change in the account balance1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 028 OUT1 933
✓
FinQaRsg2015DecemberRestrictedCashin december 2015 what was the ratio of the restricted cash and marketable securities to the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 037 OUT1 779
×
FinQaSlb2012StockRepurchaseProgramthe stock repurchase program reduced shares outstanding by how many million shares in the period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 14, expected: 78 Values: difference = 64 tolerance = 0.78
 Failed IN1 717 OUT2 689
✓
FinQaSna2007RepurchasePriceSharewhat is the average repurchase price per share paid during 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 590 OUT1 887
✓
FinQaUnp2011SimilarImprovementWouldwith a similar improvement as in 2010 , what would expected operating ratio be in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 458 OUT2 374
Reasoning - FinQA annual report calculations (set 34) 33 passed
100.0%
 IN75 617 OUT53 709
✓
FinQaAal2015ProfessionalFeesPartwhat is the percent of the professional fees as part of the total re-organization costs1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 095 OUT1 200
✓
FinQaAbmd2012FutureMinimumLeasewhat portion of total future minimum lease payments are due in fiscal 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 317 OUT1 483
✓
FinQaAmt2008EmployeeSeparationsLiabilitiesin 2006 what was percentage change in the employee separations liabilities1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 440 OUT2 165
✓
FinQaAwk2017WeightedInterestRateswhat was the percentage change in the weighted average interest rates computed on daily basis from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 166 OUT2 367
✓
FinQaCb2010BalanceTreasurywhat is the percentage change in the balance of treasury in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 005 OUT1 939
✓
FinQaCme2010DecemberParDebtas of december 31 , 2010 what was the ratio of the par value of the debt outstanding for the fixed rate notes due february 2014 to the term loan due 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 424 OUT1 165
✓
FinQaDg2007ImpairmentChargesIncluded2what was the amount of the total impairment charges included in sg&a expense from 2005 to 2007 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 821 OUT771
✓
FinQaDre2007BasicNetIncome2what is the percent change in basic net income available for common shareholders from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 189 OUT1 417
✓
FinQaDre2007NetIncomeCommonwhat is the net income per common share for the year 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 180 OUT2 108
✓
FinQaEtfc2018PreTaxGainwhat was the ratio of the unrealized pre-tax gain to the carrying value of the securities transferred from held-to-maturity securities to available-for-sale securities?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 108 OUT1 375
✓
FinQaEtr2016PaymentsNextThreewhat are the payments for the next three years on the entergy new orleans storm recovery bonds ( in millions? )1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 313 OUT1 845
✓
FinQaEtr2017NetRevenueDecreasewhat percent did net revenue decrease between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 710 OUT1 926
✓
FinQaEtr2017WithoutLossVolumewithout the loss of in volume/weather , what percent increase would net revenue have experienced between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 720 OUT2 109
✓
FinQaFis2016ReturnInvestedFidelitywhat is the dollar gain if $ 100000 are invested in fidelity national information system in 12/11 and sold in 12/16?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 692 OUT1 144
✓
FinQaGs2015SecuritiesSoldUnderwhat was the percentage change in securities sold under agreements to repurchase between 2014 and 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 219 OUT926
✓
FinQaIp2009RentIncrease2what was the percentage rent increase between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 701 OUT866
✓
FinQaJpm2009TradingAssetsDerivativesin 2008 what was the ratio of the trading assets derivatives - receivables to the payables1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 803 OUT1 739
✓
FinQaJpm2015NetRevenueInterest2what percentage of total net revenue in 2015 was net interest income?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 750 OUT1 287
✓
FinQaK2006NetCashOperationsby what percent did net cash from operations increase between 2004 and 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 613 OUT1 960
✓
FinQaL2009GrowthLoewsCommonwhat was the growth rate of the loews common stock from december 31 , 2004 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 856 OUT1 167
✓
FinQaLmt2014OperatingMarginwhat was the difference in operating margin between 2012 and 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 457 OUT1 879
✓
FinQaLmt2014WeightedCommonShares3what was the average weighted average common shares outstanding for diluted computations from 2012 to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 214 OUT2 297
✓
FinQaLmt2015NovemberCostsAssociatedin november 2015 what was the percent of the costs associated with issuing of the notes under the 364-day facility used to finance the acquisition1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 337 OUT2 230
✓
FinQaPm2017BasisPointsPostretirementwhat is the change in basis points of the rate of postretirement plans from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 449 OUT1 572
✓
FinQaRsg2018DeclineEquityActualwhat was the percentage decline in the equity from 2017 to 2018 actual1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 951 OUT2 310
✓
FinQaSlg2011BalanceVestedwhat percentage of the beginning balance of 2010 was vested during the year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 450 OUT1 456
✓
FinQaSna2007CashDividendsPaid2based on the cash dividends paid in 2007 , how many common stock shares were outstanding?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 598 OUT1 990
✓
FinQaSna2007CashFlowProvidedwhat was the average cash flow provided from operating activities from 2005 to to 2007 $ 231.1 million in 2007 , $ 203.4 million in 2006 , and $ 221.1 million in 2005 .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 642 OUT1 908
✓
FinQaSna2013TradeOtherAccountswhat percentage of trade and other accounts receivable are considered as doubtful receivables in 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 112 OUT1 322
✓
FinQaStt2007IndemnifiedSecuritiesFinancingwhat is the percent change in indemnified securities financing between 2006 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 114 OUT2 136
✓
FinQaUps2010ExpectedCashOutflow2what percentage of total expected cash outflow to satisfy contractual obligations and commitments as of december 31 , 2010 are due in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 341 OUT1 355
✓
FinQaWrk2018BalanceCompanyIncludewhat was the total balance in 2018 , if the company was to include interest and penalty liabilities?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 415 OUT916
✓
FinQaWrk2018BalanceCompanyInclude2what was the total balance in 2018 , if the company was to include interest and penalty liabilities?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 415 OUT1 379
Reasoning - FinQA annual report calculations (set 35) 3 passed
100.0%
 IN6 939 OUT4 614
✓
FinQaAnss2012RoyaltyFeesReportedwhat was the percentage change in the royalty fees are reported in cost of goods sold from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 433 OUT1 771
✓
FinQaSna2012NumberSharesNotin 2012 what was the percent change in the number of shares that was not vested1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 339 OUT1 862
✓
FinQaVrtx2006GrossRealizedGainsin 2006 what was the ratio of the gross realized gains to the losses1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 167 OUT981
Reasoning - FinQA annual report calculations (set 4) 33 passed
100.0%
 IN75 524 OUT54 117
✓
FinQaAal2013BankruptcySettlementObligationswhat portion of the total bankruptcy settlement obligations are related to single-dip equity obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 451 OUT1 222
✓
FinQaAdbe1999NetBalanceAccrualwhat is the net change in the balance of accrual related to restructurings during 1999?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 007 OUT2 131
✓
FinQaAmt2003ExpectedAggregatePrincipalwhat is the expected percentage change in aggregate principal payments of long-term debt from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 587 OUT1 733
✓
FinQaAmt2012QuarterDecemberNumberfor the quarter december 31 , 2012 what was the percent of the total number of shares purchased in december1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 976 OUT1 207
✓
FinQaAmt2014RentExpenseGreaterwas 2014 rent expense greater than 2015 operating lease expense?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 987 OUT1 310
✓
FinQaAmt2016GrowthPriceShareswhat is the growth rate in the price of shares from the highest value during the quarter ended december 31 , 2016 and the closing price on february 17 , 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 064 OUT1 357
✓
FinQaAon2007NetBalanceAccumulatedwhat is the net change in the balance of accumulated other comprehensive loss from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 476 OUT1 650
✓
FinQaAwk2014NetTaxPositionswhat was the net change in tax positions in 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 228 OUT960
✓
FinQaC2008AfterTaxGainswhat was the total after-tax gains in millions for the sale so mastercard shares from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 378 OUT1 696
✓
FinQaC2018PrincipalTransactionsRevenuewhat percentage of total principal transactions revenue in 2018 was do to interest rate risks?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 781 OUT883
✓
FinQaDisca2011CumulativeShareholderReturnwhat was the percentage cumulative total shareholder return on disca from september 18 , 2008 to december 31 , 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 908 OUT1 837
✓
FinQaDre2002GeneralAdministrativeExpensewhat is the percent change in general and administrative expense from 2000 to 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 630 OUT2 334
✓
FinQaDre2008NetIncomeCommonwhat is the net income per common share in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 315 OUT2 465
✓
FinQaEtr2016WouldNetRevenuewhat would 2015 net revenue have been in millions assuming there was no impact from both the retail electric price change and the impact of volume/weather in the year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 158 OUT1 067
✓
FinQaGpn2008NetAssetsAcquiredwhat percentage of net assets acquired was considered goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 841 OUT749
✓
FinQaGpn2010CompensationExpenseRestrictedwhat was the total compensation expense for restricted stock recognized from 2008 to 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 161 OUT1 843
✓
FinQaGs2014InventoryBalancewhat is the percentage change in inventory balance in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 459 OUT967
✓
FinQaIp2006DecemberFutureMinimumat december 31 , 2006 , what percentage of total future minimum commitments under existing non-cancelable leases and purchase obligations from lease obligations is due in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 604 OUT1 742
✓
FinQaJpm2010DecemberCollateralAbleas of december 31 , 2010 what percentage of the collateral that it was able to sell , repledge , deliver , or otherwise use was actually used for these purposes?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 945 OUT1 321
✓
FinQaJpm2018BasisPointsNetby how many basis points did net interest yield on average interest-earning assets 2013 managed basis improve form 2016 to 2017?\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 697 OUT2 159
✓
FinQaK2013UnderlyingOperatingProfitif 2014 underlying operating profit increases at the same pace as 2013 , what would it be , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 854 OUT2 929
✓
FinQaMktx2012HighMktxStockby how much did the high of mktx stock increase from 2011 to march 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 005 OUT1 766
✓
FinQaMro2003ProtectCarryingValuesby what percentage did protect carrying values of excess inventories increase from 2002 to 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 191 OUT2 359
✓
FinQaMro2013WorldwideNetAcreagewhat was average worldwide net acreage expiring in the total three year period , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 415 OUT1 507
✓
FinQaNclh2018CapitalizedInterestwhat is the percentage change in capitalized interest from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 650 OUT1 419
✓
FinQaPnc2007ResidentialMortgageLoanfor 2007 and 2006 in millions , what was average residential mortgage loan balance?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 089 OUT1 036
✓
FinQaPnc2012ResidentialMortgagesIncreaseby what percentage did total residential mortgages increase from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 516 OUT1 424
✓
FinQaPnc2014EquityInvestmentBalanceswhat was the change in millions in the unfunded commitments included in equity investment balances from december 31 , 2013 to december 31 , 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 279 OUT2 108
✓
FinQaRsg2016TonsHedgedwhat was the ratio of the tons hedged in 2017 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 774 OUT993
✓
FinQaSna2012NetChanceNonwhat is the net chance in non-vested performance awards in 2012 , ( in thousands ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 343 OUT1 526
✓
FinQaUps2007ExpectedCashOutflowwhat is the total in millions of expected cash outflow to satisfy contractual obligations and commitments as of december 31 , 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 338 OUT3 295
✓
FinQaZbh2007AcquisitionIntegrationOtherwhat is the percent change in total acquisition integration and other expenses from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 640 OUT1 494
✓
FinQaZbh2009ContractualObligationsMadewhat percentage of total contractual obligations is made up of interest payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 777 OUT1 628
Reasoning - FinQA annual report calculations (set 5) 33 passed
100.0%
 IN70 296 OUT45 986
✓
FinQaAbmd2012AbiomedOutperformNasdaqdid abiomed outperform the nasdaq medical equipment index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 746 OUT748
✓
FinQaAdbe2008FinGrossLiabilityif the total fin 48 gross liability for unrecognized tax benefits at november 28 , 2008 were recognized in the future , is the amount of unrecognized tax benefits that would decrease the effective tax rate greater than the amount that would decrease goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 229 OUT1 208
✓
FinQaAes2001CompaniesHighComparedwhat was the difference in the companies high compared to its low sales price for the second quarter of 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 799 OUT1 450
✓
FinQaAnet2015CurrentPresentLeasewhat is the current portion of the present value of lease obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 958 OUT1 136
✓
FinQaAon2007AdditionsTaxPositionswhat is the difference between the additions for tax positions of prior years and the current year , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 693 OUT1 141
✓
FinQaAwk2014CanadianNolStatewhat was canadian nol's as a percentage of state nol's in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 233 OUT1 972
✓
FinQaBll2012RoiInvestmentContainerswhat is the roi of an investment in dj us containers & packaging from 2007 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 655 OUT1 383
✓
FinQaCb2010FairFinancialMarket2what is the percent change in the fair value financial market instruments as part of the hedging strategy during 2010 compare to 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 369 OUT1 421
✓
FinQaCe2016NetSpentResearchwhat is the net change in the amount spent for research and development in 2016 compare to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 152 OUT1 597
✓
FinQaCmcsa2015CableDistributionSystemswhat was the percentage cable distribution systems capital expenditures of the capital expenditures incurred in cable communications segment capital expenditures in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 078 OUT963
✓
FinQaCmcsa2015CableDistributionSystems2what was the percentage cable distribution systems capital expenditures of the capital expenditures incurred in cable communications segment capital expenditures in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 078 OUT1 259
✓
FinQaCme2017CmeGroupIncdid the cme group inc . outperform the s&p 500 over 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 749 OUT493
✓
FinQaDg2007ImpairmentChargesIncludedwhat was the change in millions of impairment charges included in sg&a expense from 2006 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 819 OUT800
✓
FinQaDg2010MaximumDepreciationCanwhat is the maximum depreciation rate that can be used for furniture fixtures and equipment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 827 OUT1 470
✓
FinQaEog2018ConsideringUnrecognizedTaxconsidering the year 2018 , what is the percentage of unrecognized tax benefits that may have an earnings impact?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 247 OUT1 930
✓
FinQaEtr2008CashFlowEntergyby how much , in thousands , did entergy gulf states louisiana's receivable from the money pool decrease from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 152 OUT1 846
✓
FinQaFis2016LongTermDebtwhat portion of the long-term debt is due in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 354 OUT1 393
✓
FinQaGpn2018UnvestedRestrictedStockwhat was the value in thousands of unvested restricted stock and performance awards at the weighted-averagegrant-datefair value as of december 31 , 2017?\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 309 OUT2 080
✓
FinQaGs2012MaximumTierCapitalin millions for 2012 and 2011 , what was the maximum tier 2 capital?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 484 OUT1 526
✓
FinQaGs2017MinimumBalanceCashin millions for 2017 and 2016 , what was the minimum balance of cash instruments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 120 OUT853
✓
FinQaHolx2006EstimatedPurchasePricewhat percentage of the estimated purchase price is goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 071 OUT1 085
✓
FinQaHst2018UnrecognizedTaxBenefitswhat was the change in million of the unrecognized tax benefits between 2017 and 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 873 OUT1 348
✓
FinQaIp2006IndustrialPackagingSaleswhat percentage of 2005 industrial packaging sales are containerboard sales?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 575 OUT1 984
✓
FinQaJkhy2017StockPerformancewhat was the percentage change in the s&p 500 stock performance from 2014 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 771 OUT1 806
✓
FinQaLmt2012WeightedCommonShareswhat is the percentage change in the weighted average common shares outstanding for basic computations from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 193 OUT1 762
✓
FinQaMktx2004DecemberSharesCommonas of december 31 , 2004 , how many total authorized shares of common stock and non-voting common stock did the company have?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 207 OUT1 109
✓
FinQaMro2003DistillatesSalesThreewhat was the sum of distillates sales volumes , in thousands of barrels per day , for the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 174 OUT1 439
✓
FinQaMro2013AcresExpiringOtherwhat was total acres expiring in millions for other africa?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 408 OUT2 066
✓
FinQaPnc2012PotentialMaximumExposureby what percentage did the potential maximum exposure decrease by the end of 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 358 OUT2 174
✓
FinQaPnc2012TdrsAssociatedCommercialin 2012 what was the percent of the total tdrs that was associated with commercial loans1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 296 OUT810
✓
FinQaSlg2001Revenuewhat was the average total revenue in 1999 , 2000 and 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 648 OUT1 521
✓
FinQaUps2007CashInflowStockwhat is the total cash inflow from the stock purchases of employees in 2007 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 033 OUT719
✓
FinQaZbh2015ExpenseNetTaxwhat was the change in total expense net of tax for share based compensation from 2014 to 2015 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 638 OUT1 494
Reasoning - FinQA annual report calculations (set 6) 32 passed1 failed
97.0%
 IN73 915 OUT60 291
✓
FinQaAal2016PassengerServicePersonnelwhat is the percent of the passenger service personnel as a part of the total number of personnel1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 218 OUT2 160
✓
FinQaAapl2003NetAssetRetirementwhat was the net change in millions of asset retirement liability in the year ended september 27 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 372 OUT900
✓
FinQaAbmd2007AssumingSameAppreciationassuming the same appreciation as 2007 , what would be the expected 2008 weighted average grant-date fair value for options?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 515 OUT3 246
✓
FinQaAdi2019CashUsedStockwhat is the total cash used of the stock repurchase during september 2019 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 031 OUT3 467
✓
FinQaAes2001CompaniesHighCompared2what was the difference in the companies high compared to its low sales price for the fourth quarter of 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 799 OUT1 171
✓
FinQaAmt2006ConstructionProgressImpairmentwhat was the average construction in progress impairment from 2004 to 2006 im millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 473 OUT1 500
✓
FinQaAmt2007RangeHeightMonopolewhat is the difference between the maximum and minimum typical height of monopole towers , in feet?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 998 OUT1 228
✓
FinQaAmt2007WoburnPropertyUsedwhat portion of the woburn property is used by the american tower corporation?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 994 OUT1 933
✓
FinQaAwk2012ChangesCompanyGrossby how much did the company's gross liability , excluding interest and penalties , for unrecognized tax benefits increase from december 31 , 2011 to december 31 , 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 043 OUT2 167
✓
FinQaC2008NonInterestRevenuewhat was the percentage change in non-interest revenue from 2007 to 2008 , using the absolute value of the 2007 amount as the base?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 084 OUT2 198
✓
FinQaCdns2018BalanceRetainedEarningswhat is the percentage change in the balance of retained earnings during 2018 after adjustments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 064 OUT2 119
✓
FinQaCdw2017GrossMarginwhat was 2017 gross margin percent?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 984 OUT693
✓
FinQaCme2010OtherCurrentAssetswhat percentage of total other current assets in 2010 is represented by the forward contract receivable?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 031 OUT1 232
✓
FinQaDre2002GainsSalesLandin 2001 , what percent of the total gains on sales ( before the impairment adjustment ) was from the sales of land?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 635 OUT1 431
✓
FinQaDvn2012DebtMaturityOccurredwhat percentage of total debt maturity occurred in 2018 and thereafter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 910 OUT1 765
✓
FinQaEcl2016LongTermDebtwhat percentage of long-term debt is current debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 466 OUT1 619
✓
FinQaEtr2016GrowthNetRevenuewhat is the growth rate in net revenue in 20016 for entergy mississippi , inc.?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 821 OUT1 774
✓
FinQaFbhs2017CabinetsSalesDoorsin 2017 what was the ratio of the cabinets sales to the doors1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 341 OUT1 370
×
FinQaGs2018TableAusNetof the $ 23 billion of 2017 inflows in connection with the verus acquisition , what percentage were in long-term aus?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.232886, expected: 0.86957 Values: difference = 0.6366839999999999 tolerance = 0.008695699999999999
 Failed IN2 569 OUT5 505
✓
FinQaHolx2009FairNonVestedwhat is the total fair value of non-vested shares as of september 26 , 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 177 OUT1 278
✓
FinQaHwm2018ConsideringExercisePriceconsidering the average exercise price of options , what is the increase in the total value of stock options observed during 2016 and 2017 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 611 OUT1 667
✓
FinQaIp2006ContractualObligationsFuturewhat percentage of contractual obligations for future payments under existing debt and lease commitments and purchase obligations at december 31 , 2006 due in 2007 is attributable to total debt repayments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 702 OUT1 247
✓
FinQaIpg2017MathematicalRangeDeferredwhat is the mathematical range of deferred acquisition payments from 2018-2022 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 227 OUT1 778
✓
FinQaJpm2008MinimumCapitalRequirementwhat is the minimum capital requirement as defined by the net capital rule in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 640 OUT1 711
✓
FinQaLmt2014EmployeeContributionswhat was the average employee contributions from 2012 to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 295 OUT1 827
✓
FinQaLmt2016OperatingProfitMfcwhat were average operating profit for mfc in millions between 2014 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 445 OUT1 264
✓
FinQaMmm2007RecognizedPreTaxin 2006 what was the percent of the recognized a pre-tax gain to the proceeds of the sale of its global branded pharmaceuticals businesses1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 383 OUT847
✓
FinQaMro2004PricePaidSharebased on the total average price paid per share , what was the total cost of the share repurchases during the 4th quarter of 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 255 OUT1 860
✓
FinQaPkg2013DecemberEquityCompensationas of december 2013 what was the value of the equity compensation plans approved by security holders to be issued upon exercise of outstanding options warrants and rights1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 887 OUT2 583
✓
FinQaRsg2018DecemberRestrictedCashas of december 312018 what was the percent of restricted cash and marketable securities dedicated to the support our insurance programs1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 010 OUT696
✓
FinQaSlg2011CompensationCommitteePutwhat amount did the compensation committee put into the maximum performance pool between jan 1 2006 and dec 31 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 464 OUT2 490
✓
FinQaStt2006MinimumPensionLiabilitywhat percent did minimum pension liability increase between 2004 and 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 427 OUT2 437
✓
FinQaUa2007DecemberScheduleCompanyas of december 312007 what was the percent of the schedule of the company 2019s future minimum payments to the total future minimum sponsorship and other marketing payments in 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 044 OUT1 128
Reasoning - FinQA annual report calculations (set 7) 31 passed1 failed1 broken
93.9%
 IN77 556 OUT65 101
✓
FinQaAal2016FullTimeEmployeeswhat portion of the total full-time employees of mainline operations are flight attendants?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 217 OUT964
✓
FinQaAbc2005SeptemberEmployeesHadas of september 30 , 2005 , what percentage of employees that had received termination notices were actually terminated?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 707 OUT1 021
✓
FinQaAdi2010GrowthBalanceMutualwhat is the growth rate in the balance of mutual funds in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 100 OUT904
×
FinQaAmat2018RoiAppliedMaterialswhat is the roi for applied materials if the investment made on october 2013 was sold 2 years later?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.2104, expected: -0.0333 Values: difference = 0.2437 tolerance = 0.000333
 Failed IN1 908 OUT977
✓
FinQaAmt2003DecemberCompanyAggregateas of december 31 , 2004 what was the percent of the the company 2019s aggregate principal payments of long- term debt due in 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 601 OUT2 547
✓
FinQaCdw2015ExpensedCompanyContributionswhat was the average amount expensed by the company for the company contributions to the profit sharing and other savings plans from 2013 to 2015 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 272 OUT1 793
✓
FinQaCdw2015HadAllPotentialhad all potential common shares been included along with the diluted weighted-average shares outstanding for the year ended dec 31 , 2015 , how many total diluted weighted-average shares would there have been?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 278 OUT861
✓
FinQaCmcsa2008ScalableInfrastructureRepresentsscalable infrastructure represents what percent of capital expenditures incurred the cable segment during 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 294 OUT913
✓
FinQaEtr2015GrowthNetRevenuewhat is the growth rate of net revenue from 2014 to 2015 ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 953 OUT1 365
✓
FinQaEtr2016GrowthNetRevenue2what is the growth rate in net revenue in 2015 for entergy corporation?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 142 OUT1 189
✓
FinQaEtr2017SumAnnualLongwhat was the sum of the annual long-term debt maturities outstanding as of december 31 , 2017 , for the next five years1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 191 OUT1 162
✓
FinQaGpn2008NetAssetsAcquired2what percentage of net assets acquired was considered goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 841 OUT625
✓
FinQaGpn2010AfterTaxSharewhat is the after-tax share-based compensation cost in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 172 OUT1 126
✓
FinQaGs2012RiskWeightedAssetswhat was the change in risk-weighted assets in millions at gs bank usa between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 488 OUT611
✓
FinQaGs2013Assetsin millions for 2013 and 2012 , what was average total assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 162 OUT1 030
✓
FinQaGs2018PreTaxEarningswhat are the pre-tax earnings in 2016 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 559 OUT954
✓
FinQaIp2006CapitalSpendingContinuingin 2005 what percentage of capital spending from continuing operations was due to consumer packaging?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 525 OUT1 881
✓
FinQaIp2006DecemberFutureMinimum2at december 31 , 2006 , what percentage of total future minimum commitments under existing non-cancelable leases and purchase obligations from lease obligations is due in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 604 OUT951
✓
FinQaIp2006IndustrialPackagingSales2what percentage of 2006 industrial packaging sales are containerboard sales?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 575 OUT1 391
✓
FinQaLmt2016OperatingExpenseswhat are the total operating expenses for 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 435 OUT1 286
✓
FinQaMmm2013DomesticManufacturerDeductionwhat was the percentage change in the domestic manufacturer 2019s deduction activity from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 712 OUT3 901
✓
FinQaMro2006DecemberBeforeTaxas of december 31 , 2005 , what was the before tax charge related to adopting fin no . 47 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 004 OUT1 692
✓
FinQaMsi2007SegmentNetSaleswhat was the average segment net sales from 2005 to 2007 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 633 OUT1 761
✓
FinQaMsi2012NumberSharesPurchasedwhat was the percent change in number of shares purchased by employees between 2010 and 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 478 OUT1 484
✓
FinQaPkg2005CompanyPurchasedEndedthe company purchased how much in millions during the year ended december 31 , 2004 and during the year ended december 31 , 2003 under purchase agreements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 019 OUT1 177
!
FinQaPkg2013DecemberEquityCompensation2as of december 312013 what was the ratio of the equity compensation plans approved by security holders remaining to be issued to the amount to be issued upon exercise of outstanding1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
AI output broken (model loop aborted)
 Broken IN1 892 OUT19 017
✓
FinQaPpg2006WouldCashExpensewhat would the cash expense for product warranties be in 2007 if the amounts increased the same percentage as in 2006 ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 745 OUT2 207
✓
FinQaRcl2016NumberBerthsShipat the end of 2016 , what was the average number of berths per ship in the global cruise fleet?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 968 OUT1 401
✓
FinQaStt2006GrowthPriceRepurchasedwhat is the growth rate in the average price of repurchased shares from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 433 OUT1 881
✓
FinQaTfx2017NumberSecuritiesApprovedwhat portion of the total number of securities approved by security holders is issued?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 614 OUT2 476
✓
FinQaUnp2018ProjectedGrowthOperatingwhat is the 2019 to 2020 projected growth rate for operating lease payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 212 OUT1 637
✓
FinQaUps2007ExpectedDividendSharewhat is the average expected dividend per share in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 047 OUT1 370
✓
FinQaZbh2009ContractualObligationsLongwhat percent of total contractual obligations was long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 775 OUT1 546
Reasoning - FinQA annual report calculations (set 8) 33 passed
100.0%
 IN75 851 OUT51 983
✓
FinQaAal2010ExpectedPaidPensionswhat is the total amount expected to be paid for pensions and retiree medical and other in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 984 OUT1 519
✓
FinQaAapl2004NetAssetRetirementwhat was the net change in asset retirement liability between 2002 and september 25 2004 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 063 OUT1 552
✓
FinQaAmt2008ResultSalesCertainas a result of the sales of certain non-core towers and other assets what was the percent of the change in the recorded net losses from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 462 OUT2 467
✓
FinQaAmt2014AggregateRentExpensewhat is the percentage change in aggregate rent expense from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 990 OUT1 461
✓
FinQaAmt2014AggregateRentExpense2what is the percentage change in aggregate rent expense from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 990 OUT1 865
✓
FinQaAmt2014FutureLeasePaymentswhat portion of future lease payments are due after 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 981 OUT1 612
✓
FinQaBlk2012LongTermComponentwhat is the percent change in long-term component changes from 12/31/2011 to 12/31/2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 491 OUT2 237
✓
FinQaBlk2015FutureCommitmentsDuewhat percent of future commitments are due after 2020?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 742 OUT1 127
✓
FinQaBll2012RoiInvestmentBallwhat is the roi of an investment in ball corporation from 2007 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 652 OUT1 414
✓
FinQaC2009DecemberAggregateCostat december 31 2009 what was the ratio of the aggregate cost to the fair value of the loans held-for-sale that are carried at locom1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 945 OUT633
✓
FinQaC2015Hqlawhat was the percent of the change in the hqla in the q4 and q3 of 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 381 OUT1 832
✓
FinQaDisca2011SeriesStockOutperformedby what percent was the value of the $100 investment in disck at december 31 , 2011 greater than the same investment in the s&p 500?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 915 OUT1 649
✓
FinQaEtr2015OctoberEntergyRecordedin october 2015 , what was the ratio of the entergy recorded a regulatory liability to the tax liability1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 957 OUT1 690
✓
FinQaEtr2016ExpectedPaymentsBondswhat is the total expected payments on the bonds for the next 5 years for entergy louisiana investment recovery funding?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 313 OUT1 748
✓
FinQaFis2006LeasedLocationsTexaswhat portion of the total leased locations , including those outside the united states , are in texas ( count the number shown for grouped states as the number for each state listed )?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 933 OUT2 797
✓
FinQaGs2017FirmCancelMoredid the firm cancel more stock options during 2017 than it repurchased in common shares?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 470 OUT1 394
✓
FinQaGs2018LargestProvisionCreditin millions for the years 2018 , 2017 , 2016 , what was the largest provision for credit losses?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 547 OUT1 112
✓
FinQaIlmn2008UncertainTaxPositionswhat was the percentage change in the uncertain tax positions from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 102 OUT2 456
✓
FinQaIntc2015SquareFootOwnedwhat is the percent of the square foot in millions owned facilities in the us to the to owned facilities1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 995 OUT817
✓
FinQaIp2006CapitalSpendingContinuing2in 2006 what percentage of capital spending from continuing operations was due to consumer packaging?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 525 OUT2 779
✓
FinQaIpg2008UnrecognizedTaxBenefitswhat percentage of unrecognized tax benefits , in 2008 , is from tax benefits that would impact effective tax rate if recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 237 OUT1 041
✓
FinQaJpm2009IncreaseTradingAssetswhat is the increase of the total trading assets between the years 2007 and 2008 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 809 OUT1 192
✓
FinQaJpm2014NetRevenueDuewhat percentage of total net revenue was due to net interest income in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 751 OUT1 031
✓
FinQaKhc2018NetIncreaseOutstandingwhat is the net increase in outstanding shares during the period of 2016 to 2018 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 254 OUT1 499
✓
FinQaMktx2004CompanyAwardedSharesin 2001 , the company awarded how many total shares to employees?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 192 OUT698
✓
FinQaMro2017GreatestUltimateTrendwhat was the greatest ultimate trend rate for health care costs ? 4.70% ( 4.70 % ) 4.50% ( 4.50 % ) 4.50% ( 4.50 % )1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 497 OUT1 542
✓
FinQaPpg2008WithoutImpactSettlementswithout the impact of settlements , what would the december 31 2008 amount of unrecognized tax benefits have been , in $ millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 431 OUT805
✓
FinQaPpg2012CostShareRepurchaseswhat was the average cost per share for the share repurchases in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 038 OUT1 231
✓
FinQaRcl2012IncreasePortCallwhat was the percentage increase in the port call costs included from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 362 OUT969
✓
FinQaSlg2001Revenue2what was the average total revenue in 1999 , 2000 and 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 648 OUT2 499
✓
FinQaStt2007CollateralHeldIndemnifiedwhat is the percent change of the amount of collateral held for indemnified securities between 2006 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 119 OUT1 952
✓
FinQaUnp2007IncreaseCashProvidedwhat was the percentage increase in the cash provided by operating activities from 2006 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 238 OUT1 458
✓
FinQaZbh2008ContractualObligationsDuewhat percentage of total contractual obligations is due to operating leases?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 837 OUT1 905
Reasoning - FinQA annual report calculations (set 9) 33 passed
100.0%
 IN75 011 OUT52 796
✓
FinQaAdbe1999RestructuringExpenseBalancefor restructuring expense , what is the total balance of severance and related charges and lease termination costs in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 005 OUT1 549
✓
FinQaAdbe2008WeightedUsefulLifeis the weighted average useful life ( years ) for purchased technology greater than localization?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 962 OUT362
✓
FinQaAdi2010NotionalUndesignatedHedgeswhat is the percentage change in the total notional amount of undesignated hedges from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 193 OUT1 691
✓
FinQaAes2001ScheduledMaturitiesDebtwhat percentage of scheduled maturities of total debt at december 31 , 2001 are due in 2002?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 246 OUT1 668
✓
FinQaAmt2005ImpairmentChargesNetwhat is the percentage change in impairment charges and net losses from 2003 to 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 478 OUT2 404
✓
FinQaAon2007UnrecognizedTaxBenefitswhat portion of the of unrecognized tax benefits would have an impact in the effective tax rate if recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 691 OUT1 532
✓
FinQaAwk2017BorrowingsDecreaseby what percentage did average borrowings decrease from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 160 OUT2 436
✓
FinQaC2008NonInterestRevenue2what was the percentage change in non-interest revenue from 2006 to 2007 , using the absolute value of the 2006 amount as the base?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 084 OUT1 973
✓
FinQaCme2017AnualizedReturnCmewhat is the anualized return for cme group from 2012 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 751 OUT2 155
✓
FinQaEcl2017StatutoryEffectiveIncomewhat is the difference between the statutory u.s . rate and the effective income tax rate in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 862 OUT1 153
✓
FinQaEtfc2012DecemberSquareFootage2as of december 2012 what is the ratio of the square footage in alpharetta , georgia to jersey city new jersey1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 950 OUT985
✓
FinQaEtr2004MoneyPoolActivitywhat is the money pool activity use of operating cash flows as a percentage of receivables from the money pool in 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 158 OUT1 475
✓
FinQaGrmn2008ConsideringContractualObligationsconsidering the contractual obligations in which payments due by 1-3 years , what is the percentage of the operating leases in relation to the total obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 983 OUT1 172
✓
FinQaGs2013CommonShareholdersEquitywhat is the percentage change in common shareholders 2019 equity due to the adjustments presented in the table to reach basel iii cet1?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 376 OUT2 052
✓
FinQaGs2013GrowthAssetswhat is the growth rate in total assets in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 170 OUT1 609
✓
FinQaGs2013GrowthFinancialLiabilitieswhat is the growth rate in total financial liabilities at fair value in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 174 OUT1 845
✓
FinQaGs2014TrustPreferredSecuritiesfor the trust preferred securities , common beneficial interests and junior subordinated debt extinguished with a recognized gain , how much in millions was not recorded in the third quarter of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 213 OUT895
✓
FinQaGs2017LevelFinancialAssetswhat was the percentage change in level 3 financial assets from 2016 to 2017 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 122 OUT1 176
✓
FinQaHwm2015BiggerInterestPenaltiesin 2015 , by what percent were the interest and penalties recognized greater than the interest income recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 346 OUT1 141
✓
FinQaJpm2009ExcludingDerivativesNetexcluding derivatives , what are net 2009 trading assets , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 797 OUT1 110
✓
FinQaLmt2014IncreaseBacklogwhat was the percent of the increase in the backlog from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 459 OUT2 585
✓
FinQaMmm2015CompanyContributionQualifiedwhat was the ratio of the company contribution to the us qualified and non-qualified pension benefits for 2015 compared to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 191 OUT2 409
✓
FinQaMrk2013PercentualDecreaseObservedwhat was the percentual decrease observed in the liabilities for accrued interest and penalties during 2012 and 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 500 OUT2 101
✓
FinQaNke2009Outstandingwhat is the total amount , in millions of dollars , of outstanding short-term debt obligations as of may 31 , 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 259 OUT1 347
✓
FinQaPnc2012DecemberUnpaidPrincipalat december 31 , 2012 , for unpaid principal balance outstanding of loans sold as a participant in these programs , what was the percentage of potential maximum exposure under the loss share arrangements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 380 OUT1 995
✓
FinQaPnc2012HomeEquityUnresolvedfor home equity unresolved asserted indemnification and repurchase claims in millions , what was the change between december 31 2012 and december 31 2011?\\n\\n\\n\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 970 OUT1 157
✓
FinQaRl2008FactoryRetailStoreswhat percentage of factory retail stores as of march 29 , 2008 where located in europe?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 089 OUT658
✓
FinQaSlg2011EndedDecemberCapitalizedfor the years ended december 31 , 2011 and 2010 in millions , what was the total capitalized to assets associated with compensation expense related to our long- term compensation plans , restricted stock and stock options?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 481 OUT1 457
✓
FinQaSyy2006RentalExpenseUnder2what was the percentage change in total rental expense under operating leases from july 1 , 2006 to july 2 , 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 656 OUT3 003
✓
FinQaUa2011DecreaseWeightedInterestwhat was the percentage decrease in the weighted average interest rates on outstanding borrowings from 2010 to 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 361 OUT1 413
✓
FinQaUnp2010QuarterEndedDecemberfor the quarter ended december 312010 what was percent of the total number of shares purchased in november1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 894 OUT1 622
✓
FinQaUnp2018ProjectedGrowthCapitalwhat is the 2019 to 2020 projected growth rate for capital lease payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 212 OUT2 028
✓
FinQaZbh2008ContractualObligationsDue2what percentage of total contractual obligations is due to long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 838 OUT638