You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 12:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Fri Mar 27, 2026 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124592189172,12sleep00-21swapper/019:07:070
126582186161,20sleep30-21swapper/319:09:423
124462177159,13sleep20-21swapper/219:06:562
126462173157,11sleep10-21swapper/119:09:331
41732450,0sleep00-21swapper/022:14:590
291982420,0sleep00-21swapper/023:30:490
161562100,0sleep20-21swapper/222:36:572
1286999104,1cyclictest16387-21apt-get20:20:120
1286999103,3cyclictest2655-21ntp_states22:30:180
1286999103,2cyclictest31811-21cstates20:50:110
1286999103,2cyclictest24419-21rm22:40:460
2182290,0sleep10-21swapper/122:45:451
15236290,0sleep10-21swapper/122:20:231
128699993,4cyclictest22904-21rm21:16:060
128699993,3cyclictest3147-21sed20:55:200
128699993,3cyclictest11357-21python22:50:180
128699993,2cyclictest31772-21ssh22:45:080
128699993,2cyclictest29877-21ssh22:27:580
128699993,2cyclictest27697-21ssh22:09:410
128699993,2cyclictest21634-21chrt00:31:060
128699993,2cyclictest16211-21ssh22:20:540
128699992,5cyclictest0-21swapper/023:24:560
128699992,4cyclictest21382-21ssh23:43:260
128699991,4cyclictest6206-21munin-run21:05:000
128699986,2cyclictest2160-21apt-get23:50:110
128699985,3cyclictest8247-21apt-get00:25:130
128699985,2cyclictest28064-21apt-get23:15:110
128699985,2cyclictest23842-21apt-get19:30:110
128699983,5cyclictest16137-21idleruntime-cro20:20:000
128699983,2cyclictest809-21runrttasks20:48:010
128699983,2cyclictest7527-21sed21:40:150
128699983,2cyclictest361-21ssh23:00:480
128699983,2cyclictest31300-21perl00:20:130
128699983,2cyclictest3076-21awk19:50:210
128699983,2cyclictest28460-21chrt19:39:040
128699983,2cyclictest27759-21ntp_states20:40:170
128699983,2cyclictest23486-21taskset19:28:350
128699983,2cyclictest22458-21cat20:30:170
128699983,2cyclictest20950-21taskset19:22:440
128699983,2cyclictest19639-21ssh22:55:050
128699983,2cyclictest18851-21chrt20:25:080
128699983,2cyclictest12278-21ssh23:55:090
128699983,2cyclictest10576-21ntp_states21:10:180
128699983,1cyclictest8670-21diskmemload00:05:530
128699983,1cyclictest6431-21apt-get21:05:100
128699982,4cyclictest3785-21/usr/sbin/munin19:55:150
128699982,4cyclictest2469-21ssh21:22:020
128699982,4cyclictest16877-21ssh22:37:250
128699982,4cyclictest0-21swapper/023:37:170
128699982,2cyclictest8670-21diskmemload00:10:360
128699982,2cyclictest7738-21ssh21:25:060
128699982,2cyclictest31527-21ssh21:53:470
128699982,2cyclictest27479-21ssh23:45:560
128699982,2cyclictest21463-21ssh21:31:010
128699982,2cyclictest21240-21ssh23:27:170
128699982,2cyclictest17793-21ssh21:45:420
128699982,2cyclictest0-21swapper/023:09:140
128699982,2cyclictest0-21swapper/000:00:100
128699982,1cyclictest18632-21perl23:10:120
128699981,2cyclictest31075-21ssh21:35:370
128699975,1cyclictest8753-21apt-get20:05:140
128699974,2cyclictest29499-21perl19:40:130
128699974,2cyclictest10150-21wget22:00:110
128699974,2cyclictest0-21swapper/000:35:110
128699972,2cyclictest809-21runrttasks20:04:140
128699972,2cyclictest809-21runrttasks19:10:070
128699972,2cyclictest8052sleep019:46:460
128699972,2cyclictest26048-21chrt20:37:490
128699972,2cyclictest0-21swapper/021:55:350
128699972,2cyclictest0-21swapper/000:15:020
128699972,1cyclictest11934-21df20:10:110
128699971,4cyclictest0-21swapper/022:15:100
128839960,5cyclictest0-21swapper/319:45:123
128739961,3cyclictest0-21swapper/121:20:121
128699964,2cyclictest15631-21diskstats19:15:010
11503260,0sleep10-21swapper/123:38:381
11441260,0sleep30-21swapper/323:06:223
964250,0sleep20-21swapper/200:37:022
128839955,0cyclictest0-21swapper/323:28:033
128839954,1cyclictest0-21swapper/322:35:243
128839951,3cyclictest814-21snmpd20:03:193
128839950,5cyclictest0-21swapper/323:53:043
128839950,5cyclictest0-21swapper/321:29:283
128839950,5cyclictest0-21swapper/320:25:123
128839950,5cyclictest0-21swapper/319:25:213
128839950,5cyclictest0-21swapper/300:18:063
128839950,4cyclictest16410-21apt-get19:15:103
128839950,4cyclictest1315-21apt-get19:50:123
128789950,5cyclictest57250irq/130-eth022:20:152
128789950,5cyclictest0-21swapper/223:51:392
128789950,5cyclictest0-21swapper/222:25:142
128789950,4cyclictest11401-21apt-get20:10:002
128789950,0cyclictest0-21swapper/222:44:172
128739955,0cyclictest0-21swapper/123:08:061
128739951,3cyclictest0-21swapper/121:30:121
128739951,3cyclictest0-21swapper/120:20:111
128739951,2cyclictest0-21swapper/123:15:111
128739951,2cyclictest0-21swapper/122:40:111
128739951,2cyclictest0-21swapper/119:20:091
128739951,2cyclictest0-21swapper/100:05:121
14498240,0sleep314500-21cpuspeed23:40:133
128839944,0cyclictest0-21swapper/323:38:413
128839944,0cyclictest0-21swapper/323:14:233
128839944,0cyclictest0-21swapper/321:42:263
128839942,1cyclictest20929-21ntpq21:15:173
128839942,1cyclictest0-21swapper/323:30:123
128839941,3cyclictest814-21snmpd20:46:343
128839941,1cyclictest0-21swapper/319:10:113
128839940,4cyclictest8670-21diskmemload23:45:103
128839940,4cyclictest4492-21diskstats21:00:123
128839940,4cyclictest0-21swapper/323:19:173
128839940,4cyclictest0-21swapper/322:55:123
128839940,4cyclictest0-21swapper/322:40:493
128839940,4cyclictest0-21swapper/322:20:153
128839940,4cyclictest0-21swapper/322:13:393
128839940,4cyclictest0-21swapper/322:03:083
128839940,4cyclictest0-21swapper/321:35:113
128839940,4cyclictest0-21swapper/300:36:133
128839940,4cyclictest0-21swapper/300:09:153
128839940,4cyclictest0-21swapper/300:00:123
128839940,3cyclictest9163-21ssh21:10:113
128839940,3cyclictest8670-21diskmemload21:22:423
128839940,3cyclictest8670-21diskmemload00:20:033
128839940,3cyclictest8255-21sh00:25:123
128839940,3cyclictest31620-21ssh22:45:033
128839940,3cyclictest30026-21ssh23:00:113
128839940,3cyclictest25317-21ssh21:50:013
128839940,3cyclictest23250-21sh21:49:033
128839940,3cyclictest2293-21ssh21:55:363
128839940,3cyclictest21141-21latency_hist19:25:013
128839940,3cyclictest12231-21ssh23:55:073
128839940,3cyclictest10212-21diskstats22:50:123
128839940,3cyclictest1019-21rm22:30:053
128839940,3cyclictest0-21swapper/322:25:043
128839940,3cyclictest0-21swapper/321:30:013
128839940,1cyclictest7250-21ntp_states23:20:163
128789944,0cyclictest0-21swapper/223:37:152
128789944,0cyclictest0-21swapper/223:06:072
128789944,0cyclictest0-21swapper/221:35:542
128789944,0cyclictest0-21swapper/221:21:132
128789943,1cyclictest8996-21tune2fs00:25:142
128789943,1cyclictest26818-21cpuspeed_turbos20:40:112
128789942,2cyclictest0-21swapper/200:32:052
128789942,1cyclictest31401-21ssh21:53:442
128789941,3cyclictest29935-21awk20:45:152
128789940,4cyclictest23994-21/usr/sbin/munin20:35:142
128789940,4cyclictest0-21swapper/223:45:162
128789940,4cyclictest0-21swapper/223:20:162
128789940,4cyclictest0-21swapper/223:10:112
128789940,4cyclictest0-21swapper/222:45:122
128789940,4cyclictest0-21swapper/221:49:362
128789940,4cyclictest0-21swapper/221:27:552
128789940,4cyclictest0-21swapper/221:16:262
128789940,4cyclictest0-21swapper/219:40:192
128789940,4cyclictest0-21swapper/200:24:132
128789940,4cyclictest0-21swapper/200:15:122
128789940,4cyclictest0-21swapper/200:05:122
128789940,3cyclictest7418-21irqstats21:05:152
128789940,3cyclictest5054-21memory21:00:172
128789940,3cyclictest28085-21sh22:59:092
128789940,3cyclictest26834-21df19:35:152
128789940,3cyclictest25978-21sh23:30:002
128789940,3cyclictest22114-21perl19:25:132
128789940,3cyclictest1848-21ssh23:01:412
128789940,3cyclictest17963-21sh21:14:212
128789940,3cyclictest15776-21users19:15:012
128789940,3cyclictest13507-21irqstats23:55:182
128789940,3cyclictest0-21swapper/219:55:002
128789940,1cyclictest7055-21grep21:40:122
128789940,1cyclictest28056-21/usr/sbin/munin23:15:182
128789940,1cyclictest15948-21/usr/sbin/munin23:25:192
128789940,1cyclictest15465-21cat23:40:162
128789940,1cyclictest11482-21ntp_states22:00:162
128789940,0cyclictest0-21swapper/222:19:172
128739944,0cyclictest0-21swapper/122:35:481
128739944,0cyclictest0-21swapper/121:56:241
128739944,0cyclictest0-21swapper/120:04:111
128739944,0cyclictest0-21swapper/100:36:521
128739942,1cyclictest0-21swapper/123:10:101
128739942,1cyclictest0-21swapper/119:50:111
128739941,2cyclictest0-21swapper/123:55:141
128739941,2cyclictest0-21swapper/123:50:121
128739941,2cyclictest0-21swapper/123:20:111
128739941,2cyclictest0-21swapper/122:30:131
128739941,2cyclictest0-21swapper/121:35:121
128739941,2cyclictest0-21swapper/121:15:111
128739941,2cyclictest0-21swapper/120:10:111
128739941,2cyclictest0-21swapper/119:35:131
128739941,2cyclictest0-21swapper/119:30:111
128739941,2cyclictest0-21swapper/119:10:121
128739941,2cyclictest0-21swapper/100:15:111
128739941,2cyclictest0-21swapper/100:10:101
128739941,1cyclictest0-21swapper/122:50:111
128739941,1cyclictest0-21swapper/119:40:121
128739940,4cyclictest0-21swapper/121:40:311
128739940,0cyclictest0-21swapper/123:30:581
128739940,0cyclictest0-21swapper/100:34:321
128839932,1cyclictest21434-21wget20:30:113
128839932,1cyclictest11520-21cat00:10:163
128839931,2cyclictest23930-21dpkg20:35:003
128839931,1cyclictest814-21snmpd20:05:013
128839930,3cyclictest8670-21diskmemload00:30:013
128839930,3cyclictest0-21swapper/322:15:083
128839930,3cyclictest0-21swapper/322:05:063
128839930,3cyclictest0-21swapper/321:05:103
128839930,3cyclictest0-21swapper/320:55:103
128839930,3cyclictest0-21swapper/320:50:113
128839930,3cyclictest0-21swapper/320:40:103
128839930,3cyclictest0-21swapper/320:20:123
128839930,3cyclictest0-21swapper/320:15:133
128839930,3cyclictest0-21swapper/320:10:003
128839930,3cyclictest0-21swapper/319:55:113
128839930,3cyclictest0-21swapper/319:40:103
128839930,3cyclictest0-21swapper/319:35:093
128839930,3cyclictest0-21swapper/319:30:113
128789932,1cyclictest814-21snmpd20:30:042
128789932,1cyclictest814-21snmpd20:20:032
128789931,2cyclictest19271-21cstates20:25:132
128789931,1cyclictest0-21swapper/222:30:122
128789930,3cyclictest8982-21expr20:05:162
128789930,3cyclictest6798-21df20:00:122
128789930,3cyclictest3785-21/usr/sbin/munin19:55:152
128789930,3cyclictest22518-21apt-get00:00:112
128789930,3cyclictest20179-21rm22:05:042
128789930,3cyclictest0-21swapper/222:50:112
128789930,3cyclictest0-21swapper/222:10:042
128789930,3cyclictest0-21swapper/221:55:052
128789930,3cyclictest0-21swapper/221:30:112
128789930,3cyclictest0-21swapper/220:55:112
128789930,3cyclictest0-21swapper/220:50:112
128789930,3cyclictest0-21swapper/220:15:152
128789930,3cyclictest0-21swapper/219:45:142
128789930,3cyclictest0-21swapper/219:30:122
128789930,3cyclictest0-21swapper/219:20:092
128789930,3cyclictest0-21swapper/219:10:112
128789930,3cyclictest0-21swapper/200:10:112
128739933,0cyclictest0-21swapper/120:50:091
128739933,0cyclictest0-21swapper/100:28:181
128739932,1cyclictest0-21swapper/123:25:111
128739932,1cyclictest0-21swapper/123:00:121
128739931,1cyclictest0-21swapper/123:45:031
128739931,1cyclictest0-21swapper/122:55:131
128739931,1cyclictest0-21swapper/122:25:141
128739931,1cyclictest0-21swapper/122:00:111
128739931,1cyclictest0-21swapper/121:45:011
128739931,1cyclictest0-21swapper/121:10:121
128739931,1cyclictest0-21swapper/121:00:111
128739931,1cyclictest0-21swapper/120:55:111
128739931,1cyclictest0-21swapper/120:45:121
128739931,1cyclictest0-21swapper/120:40:111
128739931,1cyclictest0-21swapper/120:35:011
128739931,1cyclictest0-21swapper/120:25:111
128739931,1cyclictest0-21swapper/120:15:131
128739931,1cyclictest0-21swapper/120:05:151
128739931,1cyclictest0-21swapper/119:55:151
128739931,1cyclictest0-21swapper/119:45:111
128739931,1cyclictest0-21swapper/119:15:021
128739931,1cyclictest0-21swapper/100:00:111
128739930,2cyclictest0-21swapper/123:40:111
128739930,2cyclictest0-21swapper/121:25:101
128739930,2cyclictest0-21swapper/121:05:111
128739930,2cyclictest0-21swapper/120:30:111
128739920,1cyclictest31146-21chrt22:11:381
128739920,1cyclictest26394-21chrt21:50:411
128739920,1cyclictest0-21swapper/122:15:431
128739920,1cyclictest0-21swapper/122:05:251
128739920,1cyclictest0-21swapper/119:25:101
128739920,1cyclictest0-21swapper/100:20:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional