You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 03:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Wed Apr 01, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
265152205189,11sleep10-21swapper/119:08:441
243942190172,13sleep30-21swapper/319:05:093
264522180164,12sleep00-21swapper/019:07:550
265162167149,13sleep20-21swapper/219:08:452
87052490,0sleep10-21swapper/120:40:151
304862450,0sleep00-21swapper/022:47:290
272172450,0sleep00-21swapper/021:59:090
41172440,0sleep30-21swapper/321:31:463
260222430,0sleep30-21swapper/322:45:163
46762420,0sleep00-21swapper/023:22:120
309642110,0sleep10-21swapper/100:07:451
40042100,0sleep10-21swapper/123:53:561
2686799100,7cyclictest0-21swapper/322:20:123
268379982,3cyclictest29919-21munin-run20:20:000
268379980,4cyclictest750-21munin-run00:25:010
268679961,2cyclictest0-21swapper/322:50:123
268679960,6cyclictest0-21swapper/323:25:123
26487260,0sleep10-21swapper/100:37:031
8539250,0sleep10-21swapper/123:40:141
3390250,0sleep20-21swapper/223:53:332
30755250,0sleep10-21swapper/121:45:131
268679954,1cyclictest0-21swapper/300:25:363
268679953,1cyclictest0-21swapper/320:25:123
268679950,5cyclictest0-21swapper/322:40:333
268679950,5cyclictest0-21swapper/322:35:113
268679950,5cyclictest0-21swapper/321:39:353
268679950,5cyclictest0-21swapper/321:28:493
268679950,5cyclictest0-21swapper/300:14:153
268679950,4cyclictest0-21swapper/323:30:103
268679950,1cyclictest7413-21sendmail-msp20:40:003
268679950,0cyclictest0-21swapper/322:25:163
268599955,0cyclictest31-21ksoftirqd/200:20:002
268599952,2cyclictest0-21swapper/219:50:112
268599950,5cyclictest27088-21apt-get19:10:012
268599950,5cyclictest0-21swapper/223:31:232
268599950,0cyclictest0-21swapper/222:44:492
268589951,2cyclictest0-21swapper/120:25:131
268589951,2cyclictest0-21swapper/100:25:131
268589951,1cyclictest0-21swapper/120:55:111
268589951,1cyclictest0-21swapper/100:30:111
268589950,5cyclictest0-21swapper/123:18:281
268589950,5cyclictest0-21swapper/119:40:121
268589950,5cyclictest0-21swapper/100:03:261
268379950,5cyclictest17292-21munin-run21:00:000
268379950,5cyclictest0-21swapper/022:26:140
268379950,5cyclictest0-21swapper/021:34:000
268379950,5cyclictest0-21swapper/000:10:010
268379950,1cyclictest18292-21diskstats19:55:150
268379950,0cyclictest7513-21sendmail-msp23:40:000
268379950,0cyclictest0-21swapper/000:02:340
6756240,0sleep10-21swapper/123:23:301
27197240,0sleep30-21swapper/300:05:273
268679944,0cyclictest8921-21kworker/3:223:50:043
268679943,1cyclictest19723-21head22:10:213
268679942,2cyclictest0-21swapper/319:15:123
268679941,3cyclictest25913-21ssh21:58:213
268679941,3cyclictest22234-21diskmemload22:06:343
268679941,3cyclictest15825-21ssh23:11:433
268679941,2cyclictest0-21swapper/323:45:103
268679941,2cyclictest0-21swapper/323:00:133
268679941,2cyclictest0-21swapper/322:00:113
268679941,2cyclictest0-21swapper/321:45:123
268679941,2cyclictest0-21swapper/320:45:113
268679941,2cyclictest0-21swapper/319:25:123
268679941,2cyclictest0-21swapper/300:00:113
268679940,4cyclictest0-21swapper/323:55:243
268679940,4cyclictest0-21swapper/323:55:243
268679940,4cyclictest0-21swapper/323:35:113
268679940,4cyclictest0-21swapper/323:15:093
268679940,4cyclictest0-21swapper/322:55:133
268679940,4cyclictest0-21swapper/322:30:103
268679940,4cyclictest0-21swapper/321:40:103
268679940,4cyclictest0-21swapper/321:16:293
268679940,4cyclictest0-21swapper/321:10:003
268679940,4cyclictest0-21swapper/320:30:113
268679940,4cyclictest0-21swapper/319:45:163
268679940,4cyclictest0-21swapper/319:35:123
268679940,4cyclictest0-21swapper/300:32:033
268679940,4cyclictest0-21swapper/300:24:453
268679940,3cyclictest6707-21ssh23:23:263
268679940,3cyclictest17477-21ssh00:16:413
268679940,3cyclictest15290-21/usr/sbin/munin19:50:183
268679940,3cyclictest14793-21cron20:55:003
268679940,3cyclictest1328-21ssh22:17:343
268679940,3cyclictest12569-21apt-get20:50:113
268679940,3cyclictest1232-21/usr/sbin/munin23:05:173
268599944,0cyclictest31-21ksoftirqd/221:00:012
268599944,0cyclictest0-21swapper/223:15:062
268599944,0cyclictest0-21swapper/219:45:162
268599944,0cyclictest0-21swapper/200:20:072
268599943,1cyclictest3166-21tr00:10:082
268599943,1cyclictest31-21ksoftirqd/219:20:002
268599943,1cyclictest2716-21ntp_states00:25:182
268599943,1cyclictest22589-21cut21:25:142
268599943,1cyclictest12365-21grep20:50:002
268599942,0cyclictest0-21swapper/222:45:112
268599941,3cyclictest29028-21cat22:15:132
268599941,2cyclictest0-21swapper/222:30:102
268599941,2cyclictest0-21swapper/219:20:132
268599940,4cyclictest21514-21ntp_states20:00:162
268599940,4cyclictest0-21swapper/223:25:122
268599940,4cyclictest0-21swapper/223:10:112
268599940,4cyclictest0-21swapper/223:05:112
268599940,4cyclictest0-21swapper/223:00:132
268599940,4cyclictest0-21swapper/222:27:142
268599940,4cyclictest0-21swapper/222:22:442
268599940,4cyclictest0-21swapper/221:55:132
268599940,4cyclictest0-21swapper/221:20:122
268599940,4cyclictest0-21swapper/219:30:122
268599940,4cyclictest0-21swapper/200:37:142
268599940,4cyclictest0-21swapper/200:31:552
268599940,4cyclictest0-21swapper/200:07:542
268599940,3cyclictest8678-21sh23:24:402
268599940,3cyclictest7832-21/usr/sbin/munin23:55:182
268599940,3cyclictest7832-21/usr/sbin/munin23:55:182
268599940,3cyclictest32125-21apt-get21:30:122
268599940,3cyclictest30680-21df_inode20:20:132
268599940,3cyclictest16997-21rm22:56:272
268599940,3cyclictest0-21swapper/219:45:002
268599940,2cyclictest0-21swapper/223:45:042
268599940,2cyclictest0-21swapper/222:08:202
268599940,1cyclictest7865-21/usr/sbin/munin19:35:202
268599940,1cyclictest2923-21/usr/sbin/munin19:25:152
268599940,1cyclictest27658-21/usr/sbin/munin20:15:112
268599940,1cyclictest19989-21/usr/sbin/munin21:05:162
268599940,0cyclictest0-21swapper/221:46:372
268589944,0cyclictest0-21swapper/123:01:281
268589944,0cyclictest0-21swapper/121:40:241
268589942,1cyclictest0-21swapper/122:25:121
268589942,1cyclictest0-21swapper/121:10:121
268589941,2cyclictest0-21swapper/122:55:131
268589941,2cyclictest0-21swapper/121:15:121
268589941,2cyclictest0-21swapper/119:10:121
268589940,4cyclictest0-21swapper/122:16:471
268589940,4cyclictest0-21swapper/121:21:381
268589940,2cyclictest0-21swapper/121:55:131
268589940,2cyclictest0-21swapper/100:20:101
268589940,0cyclictest0-21swapper/123:09:361
268379944,0cyclictest0-21swapper/023:19:120
268379942,1cyclictest4964-21ssh22:50:240
268379942,1cyclictest12858-21ntpq23:10:160
268379941,2cyclictest802-21snmpd00:15:450
268379940,4cyclictest27961-21apt-get22:15:100
268379940,4cyclictest0-21swapper/023:42:570
268379940,4cyclictest0-21swapper/023:30:110
268379940,4cyclictest0-21swapper/023:25:010
268379940,4cyclictest0-21swapper/023:07:550
268379940,4cyclictest0-21swapper/022:35:280
268379940,4cyclictest0-21swapper/022:30:100
268379940,4cyclictest0-21swapper/022:11:170
268379940,4cyclictest0-21swapper/022:05:010
268379940,4cyclictest0-21swapper/021:50:120
268379940,4cyclictest0-21swapper/021:38:500
268379940,4cyclictest0-21swapper/021:00:130
268379940,4cyclictest0-21swapper/020:42:550
268379940,4cyclictest0-21swapper/019:50:110
268379940,4cyclictest0-21swapper/019:30:120
268379940,4cyclictest0-21swapper/019:25:130
268379940,4cyclictest0-21swapper/019:20:130
268379940,4cyclictest0-21swapper/000:35:110
268379940,3cyclictest9296-21ssh23:55:550
268379940,3cyclictest9296-21ssh23:55:540
268379940,3cyclictest5443-21ssh23:54:480
268379940,3cyclictest29196-21/usr/sbin/munin22:00:180
268379940,3cyclictest27571-21cat20:15:000
268379940,3cyclictest2716-21ntp_states00:25:180
268379940,3cyclictest26565-21ssh21:27:000
268379940,3cyclictest18808-21ssh23:45:120
268379940,3cyclictest15648-21irqstats22:40:150
268379940,3cyclictest13886-21ssh00:30:330
268379940,3cyclictest0-21swapper/022:55:570
268379940,0cyclictest0-21swapper/023:00:430
15745240,0sleep10-21swapper/100:15:381
268679932,1cyclictest802-21snmpd21:00:103
268679932,1cyclictest802-21snmpd20:10:103
268679932,1cyclictest0-21swapper/320:00:103
268679931,2cyclictest0-21swapper/320:20:123
268679931,1cyclictest5399-21apt-get19:30:113
268679931,1cyclictest0-21swapper/321:05:093
268679931,1cyclictest0-21swapper/320:15:113
268679930,3cyclictest8050-21apt23:40:133
268679930,3cyclictest416-21apt-get19:20:133
268679930,3cyclictest21612-21apt-get00:35:103
268679930,3cyclictest0-21swapper/321:50:123
268679930,3cyclictest0-21swapper/321:20:123
268679930,3cyclictest0-21swapper/320:40:103
268679930,3cyclictest0-21swapper/320:05:123
268679930,3cyclictest0-21swapper/319:55:163
268679930,3cyclictest0-21swapper/319:40:103
268679930,3cyclictest0-21swapper/319:10:013
268599932,1cyclictest802-21snmpd21:15:112
268599932,1cyclictest5893-21tail20:35:132
268599931,2cyclictest57150irq/125-eth022:35:022
268599930,3cyclictest8155-21df_inode20:40:112
268599930,3cyclictest32682-21cut20:25:132
268599930,3cyclictest30748-21df23:35:122
268599930,3cyclictest2703-21sh22:50:102
268599930,3cyclictest2668-21/usr/sbin/munin20:30:132
268599930,3cyclictest18794-21ntp_states21:00:202
268599930,3cyclictest18260-21df22:10:132
268599930,3cyclictest16502-21sh00:00:102
268599930,3cyclictest0-21swapper/222:00:102
268599930,3cyclictest0-21swapper/221:40:102
268599930,3cyclictest0-21swapper/221:35:022
268599930,3cyclictest0-21swapper/221:10:002
268599930,3cyclictest0-21swapper/220:50:102
268599930,3cyclictest0-21swapper/220:10:112
268599930,3cyclictest0-21swapper/220:05:122
268599930,3cyclictest0-21swapper/219:55:132
268599930,1cyclictest9124-21diskstats21:50:142
268599930,1cyclictest8017-21ssh23:40:112
268589933,0cyclictest0-21swapper/123:59:391
268589933,0cyclictest0-21swapper/123:59:391
268589933,0cyclictest0-21swapper/123:10:191
268589932,1cyclictest0-21swapper/121:00:131
268589931,1cyclictest0-21swapper/123:30:101
268589931,1cyclictest0-21swapper/123:25:131
268589931,1cyclictest0-21swapper/122:50:111
268589931,1cyclictest0-21swapper/122:45:111
268589931,1cyclictest0-21swapper/122:40:101
268589931,1cyclictest0-21swapper/122:35:111
268589931,1cyclictest0-21swapper/122:30:111
268589931,1cyclictest0-21swapper/122:10:121
268589931,1cyclictest0-21swapper/121:50:121
268589931,1cyclictest0-21swapper/121:30:121
268589931,1cyclictest0-21swapper/121:25:121
268589931,1cyclictest0-21swapper/120:50:101
268589931,1cyclictest0-21swapper/120:10:181
268589931,1cyclictest0-21swapper/120:05:121
268589931,1cyclictest0-21swapper/120:00:111
268589931,1cyclictest0-21swapper/119:55:131
268589931,1cyclictest0-21swapper/119:45:111
268589931,1cyclictest0-21swapper/119:30:121
268589931,1cyclictest0-21swapper/119:15:121
268589931,1cyclictest0-21swapper/100:10:081
268589931,0cyclictest0-21swapper/120:45:111
268589930,2cyclictest46162sleep120:31:221
268589930,2cyclictest0-21swapper/123:35:111
268589930,2cyclictest0-21swapper/121:35:111
268589930,2cyclictest0-21swapper/119:50:111
268589930,2cyclictest0-21swapper/119:20:131
268379932,1cyclictest802-21snmpd20:35:250
268379932,1cyclictest30179-21cut19:15:010
268379931,2cyclictest27150-21ssh00:05:250
268379931,1cyclictest0-21swapper/020:05:120
268379930,3cyclictest22630-21ssh21:10:000
268379930,3cyclictest20876-21ssh21:40:120
268379930,3cyclictest13544-21perl19:45:130
268379930,3cyclictest10877-21df19:40:130
268379930,3cyclictest0-21swapper/022:20:010
268379930,3cyclictest0-21swapper/021:45:120
268379930,3cyclictest0-21swapper/021:20:120
268379930,3cyclictest0-21swapper/021:15:050
268379930,3cyclictest0-21swapper/021:05:090
268379930,3cyclictest0-21swapper/020:50:100
268379930,3cyclictest0-21swapper/020:45:120
268379930,3cyclictest0-21swapper/020:30:110
268379930,3cyclictest0-21swapper/020:25:120
268379930,3cyclictest0-21swapper/020:20:120
268379930,3cyclictest0-21swapper/020:00:100
268379930,3cyclictest0-21swapper/019:35:120
268379930,3cyclictest0-21swapper/019:10:120
268589921,1cyclictest0-21swapper/123:45:101
268589921,1cyclictest0-21swapper/122:00:111
268589921,1cyclictest0-21swapper/120:20:111
268589921,1cyclictest0-21swapper/119:35:121
268589920,1cyclictest29693-21chrt20:17:291
268589920,1cyclictest0-21swapper/122:22:051
268589920,1cyclictest0-21swapper/122:05:021
268589920,1cyclictest0-21swapper/121:05:101
268589920,1cyclictest0-21swapper/120:35:101
268589920,1cyclictest0-21swapper/119:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional