You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 23:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4.osadl.org (updated Wed Nov 26, 2025 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2569282227169,46sleep10-21swapper/107:07:411
2570562226170,18sleep00-21swapper/007:09:330
2569402226167,18sleep40-21swapper/407:07:524
2569982225191,22sleep60-21swapper/607:08:426
2548472223168,17sleep50-21swapper/507:05:365
2569992221187,22sleep70-21swapper/707:08:437
2570962220186,21sleep30-21swapper/307:10:003
2568442217184,21sleep20-21swapper/207:06:292
257298993228,3cyclictest0-21swapper/310:52:283
257307993127,3cyclictest413342-21latency_hist11:55:005
25730799310,3cyclictest307926-21apt-get08:40:595
25730399300,2cyclictest427574-21apt-get12:20:554
25729899300,29cyclictest345461-21awk09:50:013
25729899300,28cyclictest294434-21apt-get08:15:563
25729399300,29cyclictest279964-21turbostat.cron07:50:002
257289993028,1cyclictest0-21swapper/008:15:010
25731399290,28cyclictest0-21swapper/712:25:567
257309992928,1cyclictest337825-21apt-get09:35:556
257309992927,2cyclictest0-21swapper/609:00:546
257309992927,1cyclictest0-21swapper/608:45:006
25730799290,28cyclictest0-21swapper/512:05:005
25730799290,28cyclictest0-21swapper/508:05:565
25730799290,28cyclictest0-21swapper/508:05:565
25730799290,28cyclictest0-21swapper/507:55:565
25730799290,28cyclictest0-21swapper/507:55:565
25730799290,28cyclictest0-21swapper/507:15:585
257303992927,2cyclictest329254-21apt09:20:014
257303992927,1cyclictest0-21swapper/408:55:574
25730399290,28cyclictest0-21swapper/411:05:554
257298992927,2cyclictest0-21swapper/312:20:563
257298992927,2cyclictest0-21swapper/309:00:543
25729899290,28cyclictest0-21swapper/312:15:573
25729899290,1cyclictest0-21swapper/311:40:003
25729899290,1cyclictest0-21swapper/308:15:003
257293992927,1cyclictest357207-21apt-get10:10:572
257293992927,1cyclictest0-21swapper/211:20:002
25729399290,28cyclictest0-21swapper/211:25:572
25729399290,1cyclictest266430-21apt-get07:25:542
257292992928,1cyclictest0-21swapper/110:45:561
25729299290,1cyclictest370673-21apt-get10:35:561
25729299290,1cyclictest310133-21apt08:45:001
25729299290,1cyclictest0-21swapper/109:55:561
257289992927,1cyclictest419488-21apt-get12:05:560
25728999290,29cyclictest326592-21awk09:15:010
25728999290,29cyclictest0-21swapper/010:50:000
25728999290,28cyclictest0-21swapper/010:05:550
25728999290,28cyclictest0-21swapper/008:40:590
257313992828,0cyclictest0-21swapper/708:55:567
257313992827,1cyclictest0-21swapper/711:55:577
257313992826,1cyclictest293861-21apt-key08:15:007
25731399280,0cyclictest0-21swapper/707:55:567
25731399280,0cyclictest0-21swapper/707:55:567
257309992827,1cyclictest277757-21apt-get07:45:576
257309992826,2cyclictest0-21swapper/612:20:566
257307992827,0cyclictest0-21swapper/511:30:555
25730799280,27cyclictest0-21swapper/508:30:565
257303992827,1cyclictest0-21swapper/407:30:564
257303992826,1cyclictest285356-21munin-run08:00:004
257303992826,1cyclictest285356-21munin-run08:00:004
25730399280,27cyclictest0-21swapper/408:50:554
25730399280,0cyclictest0-21swapper/411:10:554
257298992825,3cyclictest0-21swapper/309:35:553
257293992827,1cyclictest403054-21apt-get11:35:562
257293992827,1cyclictest0-21swapper/207:55:552
257293992827,1cyclictest0-21swapper/207:55:552
257293992826,1cyclictest0-21swapper/208:05:572
257293992826,1cyclictest0-21swapper/208:05:572
257293992825,2cyclictest331960-21sh09:25:012
25729399280,27cyclictest0-21swapper/211:20:562
25729399280,0cyclictest0-21swapper/212:00:552
257292992827,1cyclictest0-21swapper/112:10:561
257292992827,1cyclictest0-21swapper/108:25:561
257292992826,1cyclictest0-21swapper/109:05:021
25729299280,0cyclictest0-21swapper/110:30:571
257289992827,1cyclictest263747-21apt-get07:20:570
257289992826,1cyclictest0-21swapper/012:15:000
257313992727,0cyclictest0-21swapper/710:30:587
257313992727,0cyclictest0-21swapper/707:10:577
257313992725,1cyclictest0-21swapper/711:40:007
257313992724,2cyclictest0-21swapper/711:50:577
257309992727,0cyclictest0-21swapper/609:40:576
257309992725,1cyclictest0-21swapper/609:10:006
257309992723,3cyclictest0-21swapper/610:05:006
257307992727,0cyclictest0-21swapper/509:30:555
25730799270,0cyclictest0-21swapper/511:10:565
25730799270,0cyclictest0-21swapper/507:40:145
257303992727,0cyclictest0-21swapper/408:15:564
257303992727,0cyclictest0-21swapper/407:45:574
257303992727,0cyclictest0-21swapper/407:40:564
257303992726,1cyclictest0-21swapper/412:15:574
257303992725,1cyclictest408452-21apt-get11:45:564
257298992727,0cyclictest0-21swapper/309:09:343
257298992725,1cyclictest0-21swapper/310:20:563
257298992725,1cyclictest0-21swapper/307:20:583
257293992727,0cyclictest0-21swapper/212:35:562
257293992727,0cyclictest0-21swapper/212:35:562
257293992727,0cyclictest0-21swapper/210:40:582
257293992726,1cyclictest0-21swapper/208:50:552
25729399270,27cyclictest0-21swapper/208:40:592
25729399270,0cyclictest0-21swapper/207:20:582
257292992727,0cyclictest0-21swapper/108:35:551
257292992727,0cyclictest0-21swapper/107:45:571
257292992726,1cyclictest0-21swapper/108:10:551
25729299270,0cyclictest0-21swapper/109:10:571
257289992727,0cyclictest0-21swapper/012:15:570
257289992727,0cyclictest0-21swapper/007:25:540
25728999270,0cyclictest0-21swapper/011:20:560
257313992626,0cyclictest0-21swapper/711:05:557
257313992626,0cyclictest0-21swapper/707:40:557
257313992624,1cyclictest329757-21apt-get09:20:567
257313992624,1cyclictest0-21swapper/710:35:567
257309992624,2cyclictest0-21swapper/610:55:566
257309992623,3cyclictest0-21swapper/609:35:016
257307992626,0cyclictest0-21swapper/509:10:575
257307992626,0cyclictest0-21swapper/508:35:555
257307992626,0cyclictest0-21swapper/507:45:575
257303992626,0cyclictest0-21swapper/410:25:564
257303992626,0cyclictest0-21swapper/410:05:554
257303992626,0cyclictest0-21swapper/407:50:554
257303992625,1cyclictest400365-21apt-get11:30:554
257298992625,1cyclictest0-21swapper/312:00:563
257298992625,1cyclictest0-21swapper/308:55:003
257298992625,1cyclictest0-21swapper/307:45:573
257298992623,2cyclictest0-21swapper/310:25:563
257293992626,0cyclictest0-21swapper/209:25:592
257293992625,1cyclictest0-21swapper/212:05:562
257293992625,1cyclictest0-21swapper/210:55:562
257293992625,1cyclictest0-21swapper/207:35:562
257293992624,1cyclictest0-21swapper/208:30:002
257292992626,0cyclictest0-21swapper/111:30:551
257292992626,0cyclictest0-21swapper/111:10:551
257292992626,0cyclictest0-21swapper/108:30:561
257289992626,0cyclictest0-21swapper/008:45:570
257289992625,1cyclictest400365-21apt-get11:30:540
257289992624,1cyclictest297147-21apt-get08:20:570
257313992525,0cyclictest0-21swapper/710:55:567
257313992525,0cyclictest0-21swapper/709:00:557
257313992525,0cyclictest0-21swapper/708:15:017
257313992524,1cyclictest0-21swapper/711:45:567
257313992524,1cyclictest0-21swapper/709:50:017
257309992525,0cyclictest0-21swapper/608:15:016
257309992524,1cyclictest413828-21apt-get11:55:566
257309992523,1cyclictest343226-21apt-get09:45:586
257309992523,1cyclictest0-21swapper/612:10:006
257309992523,1cyclictest0-21swapper/610:50:006
257309992523,1cyclictest0-21swapper/609:30:016
257309992523,1cyclictest0-21swapper/608:05:006
257309992523,1cyclictest0-21swapper/608:05:006
257309992523,1cyclictest0-21swapper/607:40:566
257307992525,0cyclictest0-21swapper/512:30:555
257307992525,0cyclictest0-21swapper/512:30:555
257307992525,0cyclictest0-21swapper/511:20:565
257307992525,0cyclictest0-21swapper/510:30:575
257307992525,0cyclictest0-21swapper/510:25:565
257307992525,0cyclictest0-21swapper/509:50:565
257307992525,0cyclictest0-21swapper/509:25:595
257307992525,0cyclictest0-21swapper/509:20:555
257307992525,0cyclictest0-21swapper/508:00:565
257307992525,0cyclictest0-21swapper/508:00:565
257307992525,0cyclictest0-21swapper/507:20:575
257307992524,1cyclictest274041-21idleruntime-cro07:40:005
257303992525,0cyclictest0-21swapper/410:20:574
257298992524,1cyclictest0-21swapper/312:35:563
257298992524,1cyclictest0-21swapper/312:35:563
257298992524,1cyclictest0-21swapper/309:15:573
257293992525,0cyclictest0-21swapper/207:30:552
257293992524,1cyclictest0-21swapper/209:55:012
257292992524,1cyclictest0-21swapper/111:10:001
257289992525,0cyclictest0-21swapper/008:15:550
257289992524,1cyclictest0-21swapper/011:45:560
257289992523,1cyclictest318696-21apt-get09:00:550
257313992421,3cyclictest0-21swapper/712:20:567
257309992424,0cyclictest0-21swapper/611:05:556
257309992424,0cyclictest0-21swapper/608:55:566
257307992424,0cyclictest0-21swapper/510:00:555
257307992424,0cyclictest0-21swapper/509:50:015
257307992423,1cyclictest354517-21apt-get10:05:555
257307992422,1cyclictest321647-21apt-get09:05:555
257303992424,0cyclictest0-21swapper/411:35:564
257303992424,0cyclictest0-21swapper/410:50:564
257303992424,0cyclictest0-21swapper/409:35:554
257303992424,0cyclictest0-21swapper/409:30:554
257303992424,0cyclictest0-21swapper/407:35:564
257298992424,0cyclictest0-21swapper/307:40:563
257298992423,1cyclictest0-21swapper/308:25:553
257298992423,1cyclictest0-21swapper/307:35:563
257298992423,0cyclictest0-21swapper/310:40:583
257298992422,1cyclictest362104-21idleruntime-cro10:20:003
257298992422,1cyclictest0-21swapper/312:30:003
257293992424,0cyclictest0-21swapper/210:00:552
257293992424,0cyclictest0-21swapper/208:00:572
257293992424,0cyclictest0-21swapper/208:00:572
257293992423,0cyclictest0-21swapper/210:35:562
257292992424,0cyclictest0-21swapper/111:20:561
257292992424,0cyclictest0-21swapper/109:50:011
257292992424,0cyclictest0-21swapper/108:00:571
257292992424,0cyclictest0-21swapper/108:00:571
257289992424,0cyclictest0-21swapper/010:50:560
257313992321,2cyclictest0-21swapper/710:52:287
257313992321,1cyclictest0-21swapper/709:09:347
257309992323,0cyclictest0-21swapper/610:55:006
257309992323,0cyclictest0-21swapper/607:50:566
257309992321,2cyclictest0-21swapper/609:55:566
257309992321,1cyclictest268652-21munin-run07:30:006
257309992321,1cyclictest0-21swapper/611:00:556
25730999230,15cyclictest0-21swapper/609:10:576
257307992323,0cyclictest0-21swapper/507:50:565
257303992323,0cyclictest0-21swapper/410:15:564
257303992323,0cyclictest0-21swapper/408:25:564
257293992323,0cyclictest0-21swapper/208:45:562
257292992323,0cyclictest0-21swapper/111:35:561
257292992323,0cyclictest0-21swapper/109:05:001
257289992322,1cyclictest0-21swapper/007:15:000
257289992321,1cyclictest3820478-21systemd-journal09:30:010
257289992321,1cyclictest337337-21cron09:35:010
257313992222,0cyclictest0-21swapper/712:15:577
257309992222,0cyclictest0-21swapper/607:30:556
257309992220,2cyclictest0-21swapper/612:25:556
257307992222,0cyclictest0-21swapper/512:30:005
257307992222,0cyclictest0-21swapper/510:35:565
257303992222,0cyclictest0-21swapper/412:10:564
257303992222,0cyclictest0-21swapper/409:50:564
257303992221,1cyclictest0-21swapper/411:40:574
257298992222,0cyclictest0-21swapper/311:05:553
257298992222,0cyclictest0-21swapper/309:40:573
257298992221,1cyclictest0-21swapper/307:55:563
257298992221,1cyclictest0-21swapper/307:55:563
257292992222,0cyclictest0-21swapper/109:15:571
257292992220,1cyclictest435156-21sh12:35:001
257292992220,1cyclictest435156-21sh12:35:001
257289992222,0cyclictest0-21swapper/010:10:570
257289992222,0cyclictest0-21swapper/009:40:560
257313992119,2cyclictest0-21swapper/709:35:557
257309992121,0cyclictest0-21swapper/611:40:576
257309992119,1cyclictest389582-21apt-get11:10:566
257307992121,0cyclictest0-21swapper/510:10:565
257307992119,1cyclictest349120-21apt-get09:55:565
257303992121,0cyclictest0-21swapper/409:40:564
257303992118,3cyclictest419035-21awk12:05:004
257293992121,0cyclictest0-21swapper/207:15:582
257293992120,1cyclictest0-21swapper/209:15:002
257292992121,0cyclictest0-21swapper/109:50:561
257292992120,1cyclictest0-21swapper/111:50:571
257292992120,1cyclictest0-21swapper/110:40:581
257292992120,1cyclictest0-21swapper/108:45:571
257313992019,1cyclictest0-21swapper/707:20:587
257313992018,1cyclictest362608-21apt-get10:20:567
257309992019,1cyclictest392271-21apt-get11:15:566
257309992018,1cyclictest0-21swapper/608:50:006
257307992019,1cyclictest0-21swapper/509:05:015
257303992020,0cyclictest0-21swapper/410:55:564
257303992018,1cyclictest297147-21apt-get08:20:574
257293992019,1cyclictest0-21swapper/210:15:562
257292992020,0cyclictest0-21swapper/107:50:561
257313991919,0cyclictest0-21swapper/712:00:567
257313991919,0cyclictest0-21swapper/708:55:007
257313991918,1cyclictest0-21swapper/712:35:567
257313991918,1cyclictest0-21swapper/712:35:567
257313991918,1cyclictest0-21swapper/709:15:577
257313991918,1cyclictest0-21swapper/707:45:577
257309991914,4cyclictest367742-21date10:30:006
257303991919,0cyclictest0-21swapper/410:10:574
257298991917,1cyclictest282646-21sh07:55:003
257293991919,0cyclictest0-21swapper/211:40:572
257293991919,0cyclictest0-21swapper/210:20:562
257293991918,1cyclictest0-21swapper/210:00:012
257293991917,1cyclictest384205-21apt-get11:00:562
257292991919,0cyclictest0-21swapper/112:05:561
257292991917,1cyclictest407978-21munin-run11:45:001
257292991917,1cyclictest1-21systemd11:26:041
257289991919,0cyclictest0-21swapper/012:00:010
257289991917,1cyclictest397674-21apt-get11:25:570
257313991817,1cyclictest0-21swapper/710:25:567
257309991817,1cyclictest0-21swapper/607:55:566
257309991817,1cyclictest0-21swapper/607:55:566
257309991814,4cyclictest0-21swapper/611:26:066
257309991811,3cyclictest413388-21unin-run11:55:006
25730999180,17cyclictest0-21swapper/607:10:596
257307991818,0cyclictest0-21swapper/509:15:575
257303991818,0cyclictest0-21swapper/412:25:564
257303991818,0cyclictest0-21swapper/408:30:574
257303991818,0cyclictest0-21swapper/408:05:574
257303991818,0cyclictest0-21swapper/408:05:574
257303991816,1cyclictest0-21swapper/409:10:574
257293991818,0cyclictest0-21swapper/212:10:562
257293991816,1cyclictest416046-21munin-run12:00:002
257293991814,3cyclictest427514-21sshd12:20:322
257289991818,0cyclictest0-21swapper/010:00:550
257289991818,0cyclictest0-21swapper/008:00:010
257289991818,0cyclictest0-21swapper/008:00:010
257289991818,0cyclictest0-21swapper/007:30:560
257313991717,0cyclictest0-21swapper/710:40:587
257313991717,0cyclictest0-21swapper/707:35:567
257313991716,1cyclictest362105-21dump-pmu-power10:20:007
257313991716,1cyclictest0-21swapper/709:40:577
257309991715,1cyclictest367987-21apt-get10:30:586
25730999170,16cyclictest0-21swapper/608:35:456
25730999170,14cyclictest0-21swapper/612:10:566
257307991716,1cyclictest299835-21apt-get08:25:565
257303991717,0cyclictest0-21swapper/408:40:004
257298991716,1cyclictest0-21swapper/311:40:573
25729399170,16cyclictest323707-21taskset09:08:092
257292991717,0cyclictest0-21swapper/112:35:561
257292991717,0cyclictest0-21swapper/112:35:561
257292991717,0cyclictest0-21swapper/110:15:561
25729299170,16cyclictest295330-21irqstats08:15:591
257289991717,0cyclictest0-21swapper/008:00:000
257289991717,0cyclictest0-21swapper/008:00:000
257289991716,1cyclictest282685-21awk07:55:000
257313991616,0cyclictest0-21swapper/708:25:557
257313991614,1cyclictest0-21swapper/707:15:017
257309991616,0cyclictest0-21swapper/611:35:566
25730999161,15cyclictest0-21swapper/610:06:036
25730999160,16cyclictest0-21swapper/608:34:526
25730999160,16cyclictest0-21swapper/608:08:086
25730999160,16cyclictest0-21swapper/608:08:086
257307991616,0cyclictest0-21swapper/512:10:565
257307991616,0cyclictest0-21swapper/510:45:565
257307991614,1cyclictest291484-21apt-get08:10:555
257303991616,0cyclictest0-21swapper/409:05:554
25730399160,15cyclictest288314-21idleruntime-cro08:05:004
25730399160,15cyclictest288314-21idleruntime-cro08:05:004
257298991616,0cyclictest0-21swapper/310:35:563
257298991616,0cyclictest0-21swapper/308:20:573
257298991614,1cyclictest398394-21perl11:25:593
25729899160,2cyclictest808-21gdbus10:00:013
25729899160,1cyclictest0-21swapper/309:50:593
25729899160,15cyclictest0-21swapper/311:59:353
25729899160,15cyclictest0-21swapper/311:15:293
25729899160,15cyclictest0-21swapper/310:59:043
25729899160,15cyclictest0-21swapper/310:01:343
25729899160,15cyclictest0-21swapper/309:10:293
25729899160,15cyclictest0-21swapper/308:34:313
25729899160,15cyclictest0-21swapper/307:31:353
25729899160,15cyclictest0-21swapper/307:28:003
25729899160,15cyclictest0-21swapper/307:15:323
25729899160,15cyclictest0-21swapper/307:11:043
257293991614,1cyclictest0-21swapper/210:30:582
257292991615,1cyclictest0-21swapper/107:25:001
25729299160,1cyclictest0-21swapper/107:41:031
25729299160,15cyclictest0-21swapper/112:27:111
25729299160,15cyclictest0-21swapper/111:58:571
25729299160,15cyclictest0-21swapper/111:03:311
25729299160,15cyclictest0-21swapper/107:58:301
25729299160,15cyclictest0-21swapper/107:58:301
25728999160,15cyclictest407741-21taskset11:41:580
257313991515,0cyclictest0-21swapper/709:54:337
257313991514,1cyclictest0-21swapper/711:45:007
257313991514,1cyclictest0-21swapper/711:21:037
257313991514,1cyclictest0-21swapper/708:47:367
257313991513,1cyclictest0-21swapper/707:51:037
25731399150,15cyclictest0-21swapper/712:34:497
25731399150,15cyclictest0-21swapper/712:34:497
25731399150,15cyclictest0-21swapper/711:10:587
25731399150,15cyclictest0-21swapper/710:14:127
25731399150,15cyclictest0-21swapper/707:27:377
25731399150,0cyclictest0-21swapper/709:34:227
25731399150,0cyclictest0-21swapper/708:22:367
257309991513,2cyclictest0-21swapper/607:37:226
25730999150,15cyclictest374971-21find10:41:066
25730999150,14cyclictest0-21swapper/611:48:336
25730999150,14cyclictest0-21swapper/611:20:216
25730999150,14cyclictest0-21swapper/610:35:246
25730999150,14cyclictest0-21swapper/610:23:026
25730999150,14cyclictest0-21swapper/609:50:286
25730999150,14cyclictest0-21swapper/609:15:136
25730999150,14cyclictest0-21swapper/608:13:516
257307991514,1cyclictest267174-21perl07:25:565
257307991513,2cyclictest360919-21sed10:16:005
25730799150,1cyclictest270709-21find07:31:045
25730799150,14cyclictest0-21swapper/512:06:005
25730799150,14cyclictest0-21swapper/511:59:185
25730799150,14cyclictest0-21swapper/510:55:075
25730799150,14cyclictest0-21swapper/510:50:565
25730399150,1cyclictest0-21swapper/411:50:584
25730399150,1cyclictest0-21swapper/410:31:074
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional