You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-29 - 01:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack1slot1.osadl.org (updated Sun Jun 29, 2025 00:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2887022320,16sleep335-21ksoftirqd/319:05:263
291812226161,25sleep10-21swapper/119:05:491
292202214148,22sleep00-21swapper/019:06:200
294252203164,26sleep20-21swapper/219:09:002
6602810,1sleep121-21ksoftirqd/100:15:171
29614991916,2cyclictest28-21ksoftirqd/223:13:372
29614991612,3cyclictest28-21ksoftirqd/200:30:152
29614991414,0cyclictest28-21ksoftirqd/221:44:372
29614991412,1cyclictest28-21ksoftirqd/200:40:002
29614991313,0cyclictest28-21ksoftirqd/222:56:232
29599991310,1cyclictest9-21ksoftirqd/019:25:010
2961499124,3cyclictest60950irq/123-eno121:45:182
29614991212,0cyclictest28-21ksoftirqd/221:55:212
29614991210,1cyclictest28-21ksoftirqd/219:40:002
29614991210,1cyclictest28-21ksoftirqd/200:10:242
29599991212,0cyclictest0-21swapper/021:15:120
29599991210,1cyclictest9-21ksoftirqd/022:25:000
2962099110,4cyclictest0-21swapper/321:15:123
2961499119,1cyclictest28-21ksoftirqd/222:25:232
2961499119,1cyclictest28-21ksoftirqd/222:20:212
29614991110,1cyclictest28-21ksoftirqd/223:40:242
29614991110,1cyclictest28-21ksoftirqd/223:17:202
29614991110,1cyclictest28-21ksoftirqd/221:17:352
29614991110,1cyclictest28-21ksoftirqd/200:03:452
2959999113,4cyclictest24055-21date20:05:000
29599991110,1cyclictest9-21ksoftirqd/020:00:000
29599991110,1cyclictest9-21ksoftirqd/019:30:000
2961499109,1cyclictest28-21ksoftirqd/223:35:152
2961499109,1cyclictest28-21ksoftirqd/223:09:202
2961499109,1cyclictest28-21ksoftirqd/222:35:212
2961499109,1cyclictest28-21ksoftirqd/222:15:152
2961499109,1cyclictest28-21ksoftirqd/222:05:162
2961499109,1cyclictest28-21ksoftirqd/222:02:192
2961499109,1cyclictest28-21ksoftirqd/221:33:332
2961499109,1cyclictest28-21ksoftirqd/221:10:202
2961499109,1cyclictest28-21ksoftirqd/219:35:002
2961499109,1cyclictest28-21ksoftirqd/200:27:592
2961499109,1cyclictest28-21ksoftirqd/200:15:192
2961499109,1cyclictest28-21ksoftirqd/200:05:162
2961499108,1cyclictest28-21ksoftirqd/223:51:142
2961499108,1cyclictest28-21ksoftirqd/223:00:222
2961499108,1cyclictest28-21ksoftirqd/222:50:252
2961499108,1cyclictest28-21ksoftirqd/222:45:192
2961499108,1cyclictest28-21ksoftirqd/220:30:132
2961499108,1cyclictest28-21ksoftirqd/219:15:162
29614991010,0cyclictest28-21ksoftirqd/223:30:202
29614991010,0cyclictest28-21ksoftirqd/221:51:512
2959999101,4cyclictest10493-21cut20:45:000
2959999100,6cyclictest557-21nscd22:10:120
2959999100,10cyclictest0-21swapper/022:15:150
296209991,6cyclictest1449-21ntpd21:32:463
296149999,0cyclictest28-21ksoftirqd/223:57:172
296149999,0cyclictest28-21ksoftirqd/200:20:202
296149998,1cyclictest28-21ksoftirqd/223:45:172
296149998,1cyclictest28-21ksoftirqd/223:45:172
296149998,1cyclictest28-21ksoftirqd/223:27:202
296149998,1cyclictest28-21ksoftirqd/223:24:022
296149998,1cyclictest28-21ksoftirqd/222:40:172
296149998,1cyclictest28-21ksoftirqd/222:31:272
296149998,1cyclictest28-21ksoftirqd/221:35:142
296149998,1cyclictest28-21ksoftirqd/221:25:242
296149998,1cyclictest28-21ksoftirqd/221:20:192
296149998,1cyclictest28-21ksoftirqd/219:50:002
296149998,1cyclictest28-21ksoftirqd/219:30:002
296149997,1cyclictest28-21ksoftirqd/222:10:142
296149997,1cyclictest28-21ksoftirqd/221:05:002
296149997,1cyclictest28-21ksoftirqd/220:35:172
296149997,1cyclictest28-21ksoftirqd/219:15:002
296149996,1cyclictest28-21ksoftirqd/219:45:002
296069990,4cyclictest0-21swapper/122:00:181
295999998,1cyclictest9-21ksoftirqd/019:30:000
295999997,1cyclictest9-21ksoftirqd/019:40:000
295999991,4cyclictest30597-21/usr/sbin/munin23:30:230
295999990,8cyclictest0-21swapper/021:35:170
296209987,1cyclictest35-21ksoftirqd/322:35:003
296209987,1cyclictest35-21ksoftirqd/320:05:003
296209987,1cyclictest35-21ksoftirqd/300:25:003
296209986,1cyclictest17740-21snmpd23:50:083
296209986,1cyclictest17740-21snmpd21:02:373
296209986,1cyclictest17740-21snmpd19:51:563
296209982,5cyclictest546-21irqbalance21:23:163
296209982,3cyclictest20726-21diskmemload22:10:083
296149988,0cyclictest28-21ksoftirqd/220:55:162
296149987,1cyclictest28-21ksoftirqd/220:40:162
296149987,1cyclictest28-21ksoftirqd/219:55:212
296149987,1cyclictest28-21ksoftirqd/219:50:152
296149986,1cyclictest28-21ksoftirqd/220:45:212
295999987,1cyclictest9-21ksoftirqd/023:05:000
295999986,1cyclictest3051-21cat23:35:220
295999986,1cyclictest17740-21snmpd23:04:160
295999986,1cyclictest17740-21snmpd20:46:360
295999980,4cyclictest19313-21perf19:55:000
295999980,2cyclictest4036-21/usr/sbin/munin22:55:170
27547280,0sleep10-21swapper/120:10:181
296209976,1cyclictest35-21ksoftirqd/300:10:213
296209975,1cyclictest8020-21ssh23:41:213
296209975,1cyclictest35-21ksoftirqd/323:35:193
296209975,1cyclictest35-21ksoftirqd/323:25:153
296209975,1cyclictest35-21ksoftirqd/321:45:163
296209975,1cyclictest27424-21ssh22:00:083
296209975,1cyclictest26432-21ssh22:40:233
296209975,1cyclictest17740-21snmpd23:03:133
296209975,1cyclictest17740-21snmpd22:21:393
296209975,1cyclictest17740-21snmpd21:41:293
296209975,1cyclictest17740-21snmpd21:13:043
296209975,1cyclictest17740-21snmpd20:06:593
296209975,1cyclictest17740-21snmpd19:37:013
296209975,1cyclictest1739-21ssh22:08:423
296209973,1cyclictest20726-21diskmemload21:53:193
296209971,5cyclictest546-21irqbalance22:17:363
296209971,2cyclictest0-21swapper/323:55:193
296209971,1cyclictest20726-21diskmemload23:30:223
296209970,5cyclictest0-21swapper/323:10:513
296209970,4cyclictest546-21irqbalance19:16:463
296209970,4cyclictest17740-21snmpd19:49:503
296209970,4cyclictest0-21swapper/300:35:133
296209970,4cyclictest0-21swapper/300:18:243
296209970,3cyclictest0-21swapper/323:08:323
296209970,3cyclictest0-21swapper/300:06:493
296209970,2cyclictest6138-21ssh22:56:173
296209970,2cyclictest21622-21turbostat20:00:003
296209970,2cyclictest0-21swapper/321:56:173
296209970,1cyclictest0-21swapper/323:20:243
296149977,0cyclictest0-21swapper/220:05:182
296149976,1cyclictest31954-21kworker/2:221:05:142
296149975,1cyclictest28-21ksoftirqd/220:00:202
296149975,1cyclictest17740-21snmpd20:54:332
296069972,4cyclictest0-21swapper/121:20:141
296069971,6cyclictest0-21swapper/119:20:011
296069971,3cyclictest0-21swapper/119:35:191
296069970,6cyclictest0-21swapper/122:10:591
296069970,6cyclictest0-21swapper/119:15:001
296069970,4cyclictest0-21swapper/121:41:061
296069970,4cyclictest0-21swapper/100:30:121
295999976,1cyclictest9-21ksoftirqd/020:55:000
295999976,1cyclictest9-21ksoftirqd/000:05:000
295999976,1cyclictest1322-21perl21:25:170
295999975,1cyclictest9-21ksoftirqd/022:30:000
295999975,1cyclictest819-21lldpd00:25:590
295999975,1cyclictest26356-21perf20:10:000
295999975,1cyclictest17740-21snmpd20:23:590
295999975,1cyclictest17740-21snmpd19:41:460
295999974,2cyclictest5730-21dump-pmu-power20:34:590
295999970,6cyclictest7262-1kworker/u9:023:12:430
295999970,6cyclictest700-21ssh22:05:490
295999970,6cyclictest31228-21ssh22:46:440
295999970,6cyclictest29499-21irqstats00:10:210
295999970,6cyclictest26298-21ssh21:57:410
295999970,6cyclictest26055-21hddtemp_smartct22:40:200
295999970,6cyclictest22084-21ntp_states00:00:200
295999970,6cyclictest19152-21ssh23:15:050
295999970,6cyclictest19042-21ssh21:48:180
295999970,6cyclictest16751-21users00:35:230
295999970,6cyclictest13678-21chrt21:40:200
295999970,6cyclictest13407-21apt-get23:50:180
295999970,6cyclictest13193-21ssh00:31:020
295999970,6cyclictest0-21swapper/023:55:180
295999970,6cyclictest0-21swapper/023:45:530
295999970,6cyclictest0-21swapper/023:45:530
295999970,6cyclictest0-21swapper/023:40:440
295999970,1cyclictest28905-21ssh23:26:390
295999970,1cyclictest22799-21ps22:35:210
295999970,1cyclictest1003-21perl22:50:190
295999970,1cyclictest0-21swapper/022:26:410
295999970,1cyclictest0-21swapper/021:10:180
295999970,1cyclictest0-21swapper/020:55:180
295999970,1cyclictest0-21swapper/020:35:140
296209966,0cyclictest35-21ksoftirqd/319:30:003
296209965,1cyclictest35-21ksoftirqd/320:25:013
296209965,1cyclictest35-21ksoftirqd/319:30:003
296209965,1cyclictest35-21ksoftirqd/300:25:173
296209965,1cyclictest31023-21ssh22:46:103
296209965,1cyclictest17740-21snmpd21:36:523
296209965,1cyclictest13454-21ssh00:31:443
296209965,1cyclictest11474-21ssh23:45:303
296209965,1cyclictest11474-21ssh23:45:303
296209964,1cyclictest21822-21kernelversion00:00:193
296209964,1cyclictest17740-21snmpd20:51:483
296209964,1cyclictest17740-21snmpd20:35:003
296209961,3cyclictest20726-21diskmemload22:25:183
296209960,4cyclictest0-21swapper/322:35:453
296209960,1cyclictest0-21swapper/323:16:153
296209960,1cyclictest0-21swapper/321:29:443
296149966,0cyclictest60950irq/123-eno120:25:142
296149966,0cyclictest60950irq/123-eno120:23:222
296149964,1cyclictest60950irq/123-eno120:10:152
296149964,1cyclictest28-21ksoftirqd/220:20:012
296069966,0cyclictest0-21swapper/123:12:021
296069966,0cyclictest0-21swapper/123:00:261
296069966,0cyclictest0-21swapper/122:55:251
296069963,3cyclictest0-21swapper/123:35:281
296069961,3cyclictest0-21swapper/120:25:131
296069960,6cyclictest0-21swapper/123:43:171
296069960,6cyclictest0-21swapper/121:34:521
296069960,6cyclictest0-21swapper/120:07:471
296069960,6cyclictest0-21swapper/100:39:341
296069960,5cyclictest0-21swapper/123:25:161
296069960,5cyclictest0-21swapper/121:25:371
296069960,5cyclictest0-21swapper/120:04:411
296069960,5cyclictest0-21swapper/100:05:161
296069960,4cyclictest0-21swapper/123:30:131
296069960,4cyclictest0-21swapper/121:55:191
296069960,4cyclictest0-21swapper/121:13:251
296069960,4cyclictest0-21swapper/100:21:191
296069960,3cyclictest0-21swapper/123:51:241
296069960,3cyclictest0-21swapper/123:15:031
296069960,3cyclictest0-21swapper/121:45:221
296069960,2cyclictest0-21swapper/123:05:591
296069960,2cyclictest0-21swapper/122:47:511
296069960,2cyclictest0-21swapper/122:41:171
296069960,1cyclictest0-21swapper/120:54:181
296069960,1cyclictest0-21swapper/120:40:191
296069960,1cyclictest0-21swapper/120:35:161
296069960,1cyclictest0-21swapper/119:25:401
296069960,1cyclictest0-21swapper/119:18:401
295999965,1cyclictest2579-1kworker/u9:121:30:020
295999965,1cyclictest2439-1kworker/u9:000:20:090
295999965,1cyclictest17740-21snmpd20:27:330
295999964,1cyclictest9-21ksoftirqd/019:15:000
295999963,2cyclictest27460-21/usr/sbin/munin22:00:150
295999961,1cyclictest0-21swapper/020:15:120
295999960,6cyclictest0-21swapper/020:11:430
295999960,6cyclictest0-21swapper/019:18:540
295999960,1cyclictest29424-21cpuspeed_turbos21:20:150
295999960,1cyclictest19950-21ssh21:50:100
295999960,0cyclictest0-21swapper/023:20:070
295999960,0cyclictest0-21swapper/021:07:160
295999960,0cyclictest0-21swapper/021:00:180
295999960,0cyclictest0-21swapper/000:15:030
296209954,1cyclictest13569-21ntpq19:40:183
296209953,1cyclictest543-21cron20:49:553
296209953,1cyclictest17740-21snmpd19:20:583
296209952,2cyclictest28799-21latency_hist20:15:013
296209951,1cyclictest8340-21/usr/sbin/munin20:40:163
296209950,5cyclictest0-21swapper/321:06:593
296209950,4cyclictest13867-21apt-get20:55:093
296209950,1cyclictest29793-21apt-get19:10:123
296209950,1cyclictest0-21swapper/322:50:263
296149953,1cyclictest28-21ksoftirqd/219:20:172
296069955,0cyclictest0-21swapper/122:28:211
296069955,0cyclictest0-21swapper/120:22:271
296069953,1cyclictest0-21swapper/122:20:471
296069952,1cyclictest0-21swapper/119:55:141
296069951,2cyclictest0-21swapper/120:15:151
296069950,5cyclictest0-21swapper/122:35:171
296069950,5cyclictest0-21swapper/122:05:351
296069950,5cyclictest0-21swapper/121:17:591
296069950,5cyclictest0-21swapper/120:56:361
296069950,5cyclictest0-21swapper/120:47:151
296069950,5cyclictest0-21swapper/119:31:401
296069950,4cyclictest0-21swapper/123:20:421
296069950,4cyclictest0-21swapper/119:50:141
296069950,3cyclictest0-21swapper/121:51:211
296069950,3cyclictest0-21swapper/121:00:121
296069950,3cyclictest0-21swapper/100:27:351
296069950,3cyclictest0-21swapper/100:00:061
296069950,2cyclictest0-21swapper/123:57:081
296069950,2cyclictest0-21swapper/122:30:211
296069950,2cyclictest0-21swapper/122:16:451
296069950,2cyclictest0-21swapper/121:39:111
296069950,1cyclictest0-21swapper/123:45:131
296069950,1cyclictest0-21swapper/123:45:121
296069950,1cyclictest0-21swapper/122:50:191
296069950,1cyclictest0-21swapper/100:10:211
296069950,0cyclictest0-21swapper/120:32:451
295999950,5cyclictest0-21swapper/019:45:170
296209942,1cyclictest29198-21cpuspeed_turbos20:15:143
296209941,2cyclictest5967-21apt-get20:35:143
296209941,2cyclictest0-21swapper/320:25:143
296069941,2cyclictest0-21swapper/121:05:131
296069940,1cyclictest0-21swapper/119:45:141
296069940,0cyclictest0-21swapper/119:40:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional