You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 22:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Tue Mar 24, 2026 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
196092198182,11sleep10-21swapper/107:09:401
193462192167,20sleep00-21swapper/007:06:180
194632184167,12sleep30-21swapper/307:07:493
193432175159,11sleep20-21swapper/207:06:162
193142450,0sleep30-21swapper/309:11:083
258472420,0sleep10-21swapper/109:30:151
197969997,1cyclictest31-21ksoftirqd/210:05:122
197909991,4cyclictest11950irq/132-ahci[0012:40:000
2376280,0sleep10-21swapper/112:13:381
197909982,3cyclictest6691-21munin-run12:00:000
197909970,3cyclictest369-21munin-run07:35:010
15846270,0sleep215431-21diskmemload11:00:172
197969966,0cyclictest31-21ksoftirqd/211:35:132
197919961,3cyclictest0-21swapper/109:50:121
197909960,3cyclictest27898-21munin-run07:25:010
31580250,0sleep10-21swapper/109:17:181
22508250,0sleep30-21swapper/310:15:333
198009950,4cyclictest5662-21ssh12:30:263
198009950,4cyclictest4465-21sh10:07:023
198009950,4cyclictest0-21swapper/310:33:463
198009950,4cyclictest0-21swapper/308:40:113
198009950,3cyclictest7921-21ssh10:56:093
197969955,0cyclictest31-21ksoftirqd/212:15:012
197969955,0cyclictest31-21ksoftirqd/211:50:012
197969955,0cyclictest31-21ksoftirqd/209:35:122
197969955,0cyclictest31-21ksoftirqd/209:10:012
197969953,1cyclictest31-21ksoftirqd/210:10:122
197969952,3cyclictest31-21ksoftirqd/209:50:122
197969950,5cyclictest61-21kswapd010:35:122
197969950,5cyclictest0-21swapper/210:45:392
197969950,5cyclictest0-21swapper/210:45:392
197969950,5cyclictest0-21swapper/210:17:532
197969950,4cyclictest0-21swapper/208:15:012
197969950,0cyclictest30090-21ssh10:20:032
197969950,0cyclictest0-21swapper/212:09:452
197919951,2cyclictest0-21swapper/111:05:131
197919950,5cyclictest0-21swapper/110:29:411
197919950,5cyclictest0-21swapper/110:02:551
197909954,1cyclictest24608-21/usr/sbin/munin09:45:170
197909954,1cyclictest0-21swapper/009:54:100
197909952,3cyclictest0-21swapper/010:41:330
197909951,4cyclictest30359-21idleruntime-cro07:30:010
197909951,3cyclictest0-21swapper/008:20:110
197909950,5cyclictest22786-21cat09:45:010
197909950,5cyclictest0-21swapper/012:25:030
197909950,5cyclictest0-21swapper/011:48:490
197909950,5cyclictest0-21swapper/011:27:560
197909950,5cyclictest0-21swapper/008:14:550
197909950,4cyclictest30378-21ssh10:20:130
197909950,0cyclictest29522-21ssh12:10:200
30341240,0sleep10-21swapper/110:20:111
198009944,0cyclictest13995-21kworker/3:211:40:343
198009944,0cyclictest0-21swapper/311:36:413
198009944,0cyclictest0-21swapper/310:49:153
198009944,0cyclictest0-21swapper/310:49:153
198009944,0cyclictest0-21swapper/309:51:033
198009944,0cyclictest0-21swapper/307:54:313
198009943,1cyclictest9288-21grep11:45:113
198009943,1cyclictest7027-21ntp_states08:50:183
198009943,1cyclictest3087-21/usr/sbin/munin08:45:143
198009943,1cyclictest15465-21/usr/sbin/munin12:20:203
198009942,2cyclictest32086-21kworker/3:009:18:553
198009941,3cyclictest57250irq/130-eth009:30:113
198009941,3cyclictest29944-21ssh10:50:593
198009941,2cyclictest0-21swapper/309:25:133
198009940,4cyclictest21922-21ntp_states08:15:203
198009940,4cyclictest21538-21ssh10:00:103
198009940,4cyclictest0-21swapper/312:15:113
198009940,4cyclictest0-21swapper/312:06:493
198009940,4cyclictest0-21swapper/312:00:113
198009940,4cyclictest0-21swapper/311:18:583
198009940,4cyclictest0-21swapper/310:35:183
198009940,4cyclictest0-21swapper/310:20:123
198009940,4cyclictest0-21swapper/310:13:143
198009940,4cyclictest0-21swapper/309:35:123
198009940,4cyclictest0-21swapper/307:45:113
198009940,4cyclictest0-21swapper/307:30:113
198009940,4cyclictest0-21swapper/307:27:093
198009940,4cyclictest0-21swapper/307:10:113
198009940,3cyclictest9219-21irqstats08:55:153
198009940,3cyclictest76912sleep311:12:063
198009940,3cyclictest30548-21ssh11:55:163
198009940,3cyclictest26957-21sh09:46:203
198009940,3cyclictest26504-21hddtemp_smartct12:25:163
198009940,3cyclictest26130-21expr08:25:143
198009940,3cyclictest24844-21python11:20:193
198009940,3cyclictest24716-21ssh11:05:013
198009940,3cyclictest22724-21hostname07:15:013
198009940,3cyclictest18283-21sh09:42:193
198009940,3cyclictest1798-21hddtemp_smartct11:25:173
198009940,3cyclictest17930-21sh11:00:593
198009940,3cyclictest13898-21sh10:43:393
198009940,3cyclictest13115-21cut09:05:013
198009940,3cyclictest11915-21hddtemp_smartct11:30:153
198009940,3cyclictest11284-21perl07:55:153
198009940,3cyclictest11036-21sh09:55:023
198009940,3cyclictest0-21swapper/308:35:003
198009940,2cyclictest0-21swapper/310:25:433
198009940,1cyclictest27475-21/usr/sbin/munin12:10:133
198009940,0cyclictest0-21swapper/311:54:443
198009940,0cyclictest0-21swapper/307:37:283
197969944,0cyclictest31-21ksoftirqd/210:00:112
197969944,0cyclictest31-21ksoftirqd/209:45:012
197969944,0cyclictest31-21ksoftirqd/208:35:122
197969944,0cyclictest31-21ksoftirqd/207:55:122
197969944,0cyclictest31-21ksoftirqd/207:15:012
197969943,1cyclictest31-21ksoftirqd/210:40:162
197969943,1cyclictest31-21ksoftirqd/209:55:152
197969942,1cyclictest31-21ksoftirqd/212:10:122
197969942,1cyclictest301ktimersoftd/211:15:122
197969942,1cyclictest13086-21ssh11:30:212
197969941,2cyclictest0-21swapper/207:50:112
197969940,4cyclictest3129-21apt-get07:40:112
197969940,4cyclictest23102-21apt-get11:20:112
197969940,4cyclictest15431-21diskmemload12:25:132
197969940,4cyclictest0-21swapper/212:35:112
197969940,4cyclictest0-21swapper/212:30:112
197969940,4cyclictest0-21swapper/212:24:282
197969940,4cyclictest0-21swapper/211:45:312
197969940,4cyclictest0-21swapper/211:41:172
197969940,4cyclictest0-21swapper/211:08:502
197969940,4cyclictest0-21swapper/210:50:132
197969940,4cyclictest0-21swapper/210:25:112
197969940,4cyclictest0-21swapper/209:25:222
197969940,4cyclictest0-21swapper/209:00:122
197969940,4cyclictest0-21swapper/208:55:112
197969940,3cyclictest713-21ssh11:56:192
197969940,3cyclictest6872-21ntp_states07:45:172
197969940,3cyclictest5540-21ssh11:10:452
197969940,3cyclictest5156-21df10:55:142
197969940,3cyclictest31176-21ssh09:48:552
197969940,3cyclictest30498-21wc07:30:012
197969940,3cyclictest30479-21cat08:35:002
197969940,3cyclictest18500-21df_inode08:10:142
197969940,3cyclictest14202-21rm12:03:232
197969940,3cyclictest0-21swapper/208:25:132
197969940,2cyclictest6539-21ssh11:27:352
197969940,1cyclictest27764-21ssh10:34:472
197919944,0cyclictest0-21swapper/111:04:281
197919944,0cyclictest0-21swapper/109:44:351
197919944,0cyclictest0-21swapper/108:15:311
197919942,2cyclictest0-21swapper/111:40:091
197919941,2cyclictest0-21swapper/112:35:111
197919941,2cyclictest0-21swapper/110:50:121
197919941,2cyclictest0-21swapper/110:30:111
197919941,2cyclictest0-21swapper/110:15:121
197919941,2cyclictest0-21swapper/107:30:111
197919941,2cyclictest0-21swapper/107:15:121
197919941,1cyclictest0-21swapper/112:25:131
197919940,4cyclictest0-21swapper/111:32:411
197919940,4cyclictest0-21swapper/110:57:031
197919940,4cyclictest0-21swapper/107:41:291
197919940,0cyclictest0-21swapper/112:02:051
197919940,0cyclictest0-21swapper/111:22:131
197909944,0cyclictest0-21swapper/011:02:420
197909944,0cyclictest0-21swapper/010:33:540
197909944,0cyclictest0-21swapper/007:45:140
197909943,1cyclictest14452-21head11:15:190
197909943,1cyclictest12195-21gltestperf09:55:150
197909942,2cyclictest0-21swapper/012:15:000
197909942,1cyclictest29536-21ssh10:35:150
197909941,3cyclictest814-21snmpd09:31:080
197909941,2cyclictest0-21swapper/011:10:130
197909941,2cyclictest0-21swapper/010:10:120
197909941,1cyclictest0-21swapper/008:55:110
197909941,1cyclictest0-21swapper/008:35:120
197909940,4cyclictest28681-21ssh09:15:320
197909940,4cyclictest15504-21apt-get08:05:120
197909940,4cyclictest15431-21diskmemload11:36:020
197909940,4cyclictest15431-21diskmemload10:47:190
197909940,4cyclictest15431-21diskmemload10:47:190
197909940,4cyclictest0-21swapper/012:23:210
197909940,4cyclictest0-21swapper/012:05:110
197909940,4cyclictest0-21swapper/012:00:110
197909940,4cyclictest0-21swapper/011:40:090
197909940,4cyclictest0-21swapper/011:30:200
197909940,4cyclictest0-21swapper/011:05:130
197909940,4cyclictest0-21swapper/010:50:020
197909940,4cyclictest0-21swapper/010:28:440
197909940,4cyclictest0-21swapper/010:05:120
197909940,4cyclictest0-21swapper/009:35:130
197909940,3cyclictest4079-21sh09:20:080
197909940,3cyclictest3139-21ssh12:30:010
197909940,3cyclictest28558-21ssh11:54:460
197909940,3cyclictest27015-21sh10:02:230
197909940,3cyclictest24698-21sh09:14:230
197909940,3cyclictest22798-21ssh09:29:070
197909940,3cyclictest20592-21dpkg08:15:000
197909940,3cyclictest15587-21cat09:10:010
197909940,3cyclictest13034-21apt-get08:00:120
197909940,3cyclictest11237-21df09:00:130
197909940,3cyclictest0-21swapper/010:55:030
197909940,3cyclictest0-21swapper/008:30:090
197909940,1cyclictest0-21swapper/008:55:000
198009932,1cyclictest3894-21ssh09:20:013
198009931,1cyclictest0-21swapper/309:05:123
198009930,3cyclictest3131-21dpkg07:40:103
198009930,3cyclictest14064-21df_inode12:35:123
198009930,3cyclictest0-21swapper/308:35:123
198009930,3cyclictest0-21swapper/308:20:113
198009930,3cyclictest0-21swapper/308:10:083
198009930,3cyclictest0-21swapper/308:05:013
198009930,3cyclictest0-21swapper/308:00:123
198009930,3cyclictest0-21swapper/307:20:013
197969933,0cyclictest31-21ksoftirqd/209:20:122
197969932,1cyclictest5622-21apt-config08:50:002
197969932,1cyclictest31-21ksoftirqd/208:05:122
197969931,1cyclictest26030-21ssh09:15:032
197969930,3cyclictest24572-21ssh09:30:032
197969930,3cyclictest0-21swapper/209:10:082
197969930,3cyclictest0-21swapper/208:45:102
197969930,3cyclictest0-21swapper/208:40:112
197969930,3cyclictest0-21swapper/208:00:132
197969930,3cyclictest0-21swapper/207:35:112
197969930,3cyclictest0-21swapper/207:30:112
197969930,3cyclictest0-21swapper/207:20:112
197969930,3cyclictest0-21swapper/207:15:012
197969930,0cyclictest23146-21apt-get08:20:112
197919933,0cyclictest0-21swapper/111:28:111
197919933,0cyclictest0-21swapper/111:13:201
197919933,0cyclictest0-21swapper/110:49:381
197919933,0cyclictest0-21swapper/110:49:371
197919933,0cyclictest0-21swapper/110:41:291
197919933,0cyclictest0-21swapper/110:11:301
197919932,1cyclictest0-21swapper/109:20:121
197919931,1cyclictest0-21swapper/112:20:121
197919931,1cyclictest0-21swapper/112:15:011
197919931,1cyclictest0-21swapper/112:05:111
197919931,1cyclictest0-21swapper/111:55:111
197919931,1cyclictest0-21swapper/111:45:101
197919931,1cyclictest0-21swapper/111:15:121
197919931,1cyclictest0-21swapper/110:35:121
197919931,1cyclictest0-21swapper/110:05:121
197919931,1cyclictest0-21swapper/109:57:251
197919931,1cyclictest0-21swapper/109:45:121
197919931,1cyclictest0-21swapper/109:35:121
197919931,1cyclictest0-21swapper/109:25:131
197919931,1cyclictest0-21swapper/109:10:131
197919931,1cyclictest0-21swapper/109:05:121
197919931,1cyclictest0-21swapper/109:00:131
197919931,1cyclictest0-21swapper/108:55:111
197919931,1cyclictest0-21swapper/108:50:011
197919931,1cyclictest0-21swapper/108:45:101
197919931,1cyclictest0-21swapper/108:40:111
197919931,1cyclictest0-21swapper/108:30:091
197919931,1cyclictest0-21swapper/108:10:121
197919931,1cyclictest0-21swapper/107:55:121
197919931,1cyclictest0-21swapper/107:35:111
197919931,1cyclictest0-21swapper/107:10:111
197919930,3cyclictest0-21swapper/107:53:331
197919930,2cyclictest0-21swapper/111:50:011
197919930,2cyclictest0-21swapper/111:35:131
197919930,2cyclictest0-21swapper/107:25:111
197919930,1cyclictest0-21swapper/107:45:111
197909931,1cyclictest0-21swapper/007:55:120
197909931,1cyclictest0-21swapper/007:40:110
197909930,3cyclictest8941-21sort07:50:140
197909930,3cyclictest604-21apt-get08:40:110
197909930,3cyclictest23046-21memory07:15:010
197909930,3cyclictest22117-21grep10:15:200
197909930,3cyclictest0-21swapper/011:20:060
197909930,3cyclictest0-21swapper/008:45:100
197909930,3cyclictest0-21swapper/008:25:120
197909930,3cyclictest0-21swapper/007:35:110
197909930,3cyclictest0-21swapper/007:10:020
197919921,1cyclictest276172chrt07:21:441
197919921,1cyclictest0-21swapper/108:35:121
197919921,1cyclictest0-21swapper/108:20:111
197919920,1cyclictest277752sleep108:29:131
197919920,1cyclictest0-21swapper/112:30:011
197919920,1cyclictest0-21swapper/108:00:121
197919910,1cyclictest0-21swapper/108:05:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional