You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 18:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Tue Nov 25, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11625991918,1cyclictest60250irq/125-lan09:31:312
11625991918,1cyclictest60250irq/125-lan09:31:312
11625991918,0cyclictest60250irq/125-lan11:10:112
11625991917,1cyclictest60250irq/125-lan10:00:192
11625991818,0cyclictest60250irq/125-lan12:12:062
11625991817,1cyclictest60250irq/125-lan10:35:122
11625991817,1cyclictest60250irq/125-lan07:54:032
11625991817,1cyclictest60250irq/125-lan07:10:162
11612991818,0cyclictest8257-21fwupd10:51:260
11625991717,0cyclictest60250irq/125-lan12:39:282
11625991717,0cyclictest60250irq/125-lan12:00:032
11625991716,1cyclictest60250irq/125-lan11:40:152
11625991716,1cyclictest60250irq/125-lan11:05:212
11625991716,1cyclictest60250irq/125-lan10:55:222
11625991716,1cyclictest60250irq/125-lan10:05:002
11625991716,1cyclictest60250irq/125-lan09:55:112
11625991716,1cyclictest60250irq/125-lan08:55:122
11625991716,1cyclictest60250irq/125-lan08:30:202
11625991616,0cyclictest60250irq/125-lan11:33:432
11625991616,0cyclictest60250irq/125-lan08:39:192
11625991616,0cyclictest60250irq/125-lan08:27:592
11625991615,1cyclictest60250irq/125-lan11:35:462
11625991615,1cyclictest60250irq/125-lan11:25:182
11625991615,1cyclictest60250irq/125-lan10:15:172
11625991615,1cyclictest60250irq/125-lan08:15:212
11625991615,1cyclictest60250irq/125-lan08:10:162
11625991615,1cyclictest60250irq/125-lan07:30:192
11625991514,1cyclictest60250irq/125-lan12:30:202
11625991514,1cyclictest60250irq/125-lan12:25:002
11625991514,1cyclictest60250irq/125-lan12:15:192
11625991514,1cyclictest60250irq/125-lan11:45:172
11625991514,1cyclictest60250irq/125-lan11:20:172
11625991514,1cyclictest60250irq/125-lan10:50:152
11625991514,1cyclictest60250irq/125-lan10:40:192
11625991514,1cyclictest60250irq/125-lan10:31:392
11625991514,1cyclictest60250irq/125-lan09:40:202
11625991514,1cyclictest60250irq/125-lan09:08:192
11625991514,1cyclictest60250irq/125-lan08:50:142
11625991514,1cyclictest60250irq/125-lan08:40:192
11625991514,1cyclictest60250irq/125-lan07:45:202
11625991514,1cyclictest60250irq/125-lan07:25:182
11625991514,1cyclictest60250irq/125-lan07:15:012
11612991515,0cyclictest702-21snmpd11:20:270
11612991515,0cyclictest329-21hwrng09:40:360
11612991515,0cyclictest28195-21cat09:05:150
11625991414,0cyclictest60250irq/125-lan11:55:202
11625991414,0cyclictest60250irq/125-lan09:35:162
11625991414,0cyclictest60250irq/125-lan09:24:542
11625991414,0cyclictest60250irq/125-lan08:20:192
11625991414,0cyclictest60250irq/125-lan07:21:262
11625991413,1cyclictest60250irq/125-lan11:50:202
11625991413,1cyclictest60250irq/125-lan09:15:172
11625991413,1cyclictest60250irq/125-lan09:00:172
11625991413,1cyclictest60250irq/125-lan08:45:172
11612991414,0cyclictest329-21hwrng11:13:460
11612991414,0cyclictest329-21hwrng08:01:160
11625991312,1cyclictest60250irq/125-lan12:25:142
11625991312,1cyclictest60250irq/125-lan12:05:172
11625991312,1cyclictest60250irq/125-lan11:00:132
11625991312,1cyclictest60250irq/125-lan10:10:132
11625991312,1cyclictest60250irq/125-lan07:55:142
11612991313,0cyclictest329-21hwrng07:29:320
11625991212,0cyclictest60250irq/125-lan09:25:252
11625991211,1cyclictest60250irq/125-lan10:20:132
11625991211,1cyclictest60250irq/125-lan07:40:222
11612991212,0cyclictest329-21hwrng07:35:390
11625991110,1cyclictest60250irq/125-lan10:45:162
11625991110,1cyclictest60250irq/125-lan09:50:172
11625991110,1cyclictest60250irq/125-lan08:05:122
11625991110,1cyclictest60250irq/125-lan07:39:302
11612991111,0cyclictest329-21hwrng07:51:010
11612991010,0cyclictest329-21hwrng11:40:230
11612991010,0cyclictest329-21hwrng10:35:540
11612991010,0cyclictest329-21hwrng10:32:490
11612991010,0cyclictest329-21hwrng07:18:160
116309999,0cyclictest329-21hwrng09:39:353
116259998,1cyclictest60250irq/125-lan11:15:222
116129999,0cyclictest329-21hwrng11:09:410
116129999,0cyclictest329-21hwrng10:47:100
116129999,0cyclictest329-21hwrng10:26:410
116129999,0cyclictest329-21hwrng09:55:580
116129999,0cyclictest329-21hwrng09:45:430
116129999,0cyclictest329-21hwrng07:33:380
116129999,0cyclictest329-21hwrng07:21:190
116129998,1cyclictest702-21snmpd10:04:000
116309988,0cyclictest702-21snmpd09:57:543
116309988,0cyclictest329-21hwrng11:48:363
116309988,0cyclictest329-21hwrng11:07:373
116309988,0cyclictest329-21hwrng10:51:143
116309988,0cyclictest329-21hwrng10:33:513
116309988,0cyclictest329-21hwrng10:01:053
116309988,0cyclictest329-21hwrng09:54:563
116309988,0cyclictest329-21hwrng09:10:543
116309988,0cyclictest329-21hwrng08:35:033
116309988,0cyclictest329-21hwrng08:30:583
116309988,0cyclictest329-21hwrng08:11:313
116309988,0cyclictest329-21hwrng08:03:193
116309987,1cyclictest702-21snmpd11:25:363
116309987,1cyclictest702-21snmpd09:04:343
116259987,1cyclictest60250irq/125-lan10:25:152
116259987,1cyclictest60250irq/125-lan09:45:172
116259987,1cyclictest60250irq/125-lan09:10:172
116179988,0cyclictest702-21snmpd10:50:321
116179988,0cyclictest702-21snmpd08:35:241
116179988,0cyclictest329-21hwrng09:29:191
116179988,0cyclictest329-21hwrng08:46:201
116179987,1cyclictest702-21snmpd10:01:211
116179987,1cyclictest702-21snmpd07:57:381
116129988,0cyclictest702-21snmpd11:29:440
116129988,0cyclictest702-21snmpd09:38:550
116129988,0cyclictest702-21snmpd09:24:500
116129988,0cyclictest329-21hwrng12:37:450
116129988,0cyclictest329-21hwrng11:55:460
116129988,0cyclictest329-21hwrng10:43:040
116309977,0cyclictest702-21snmpd11:13:443
116309977,0cyclictest702-21snmpd10:45:173
116309977,0cyclictest702-21snmpd10:43:133
116309977,0cyclictest702-21snmpd09:40:263
116309977,0cyclictest702-21snmpd07:18:443
116309977,0cyclictest329-21hwrng12:36:443
116309977,0cyclictest329-21hwrng12:23:253
116309977,0cyclictest329-21hwrng12:11:083
116309977,0cyclictest329-21hwrng12:07:023
116309977,0cyclictest329-21hwrng11:54:453
116309977,0cyclictest329-21hwrng11:30:103
116309977,0cyclictest329-21hwrng11:00:283
116309977,0cyclictest329-21hwrng10:55:213
116309977,0cyclictest329-21hwrng10:29:453
116309977,0cyclictest329-21hwrng10:23:353
116309977,0cyclictest329-21hwrng10:15:253
116309977,0cyclictest329-21hwrng10:14:233
116309977,0cyclictest329-21hwrng10:09:153
116309977,0cyclictest329-21hwrng09:31:233
116309977,0cyclictest329-21hwrng09:31:233
116309977,0cyclictest329-21hwrng09:20:073
116309977,0cyclictest329-21hwrng09:16:013
116309977,0cyclictest329-21hwrng08:50:243
116309977,0cyclictest329-21hwrng08:42:143
116309977,0cyclictest329-21hwrng08:25:513
116309977,0cyclictest329-21hwrng08:22:463
116309977,0cyclictest329-21hwrng08:19:423
116309977,0cyclictest329-21hwrng08:05:213
116309977,0cyclictest329-21hwrng07:59:143
116309977,0cyclictest329-21hwrng07:50:013
116309977,0cyclictest329-21hwrng07:41:493
116309977,0cyclictest329-21hwrng07:32:363
116309976,1cyclictest702-21snmpd12:19:433
116309976,1cyclictest702-21snmpd09:09:553
116259975,2cyclictest702-21snmpd08:00:502
116179977,0cyclictest702-21snmpd11:51:131
116179977,0cyclictest702-21snmpd11:49:001
116179977,0cyclictest702-21snmpd11:21:571
116179977,0cyclictest702-21snmpd10:42:581
116179977,0cyclictest702-21snmpd10:29:131
116179977,0cyclictest702-21snmpd08:15:261
116179977,0cyclictest329-21hwrng09:54:551
116179977,0cyclictest329-21hwrng09:16:011
116179977,0cyclictest329-21hwrng08:11:311
116179976,1cyclictest702-21snmpd11:01:141
116179976,1cyclictest702-21snmpd09:43:051
116179976,1cyclictest702-21snmpd09:24:081
116179976,1cyclictest702-21snmpd08:20:261
116129977,0cyclictest702-21snmpd12:02:220
116129977,0cyclictest702-21snmpd11:38:060
116129977,0cyclictest702-21snmpd08:28:170
116129976,1cyclictest702-21snmpd11:34:120
116129976,1cyclictest702-21snmpd10:08:120
116129975,2cyclictest702-21snmpd09:51:150
116129975,2cyclictest702-21snmpd07:46:310
116309966,0cyclictest329-21hwrng12:31:363
116309966,0cyclictest329-21hwrng12:28:323
116309966,0cyclictest329-21hwrng11:40:243
116309966,0cyclictest329-21hwrng11:15:503
116309966,0cyclictest329-21hwrng09:46:453
116309966,0cyclictest329-21hwrng09:28:193
116309966,0cyclictest329-21hwrng08:45:183
116309966,0cyclictest329-21hwrng07:25:263
116309966,0cyclictest329-21hwrng07:10:043
116309965,1cyclictest702-21snmpd11:38:543
116309964,2cyclictest702-21snmpd07:20:513
116179966,0cyclictest702-21snmpd10:55:351
116179966,0cyclictest702-21snmpd10:09:511
116179966,0cyclictest702-21snmpd09:47:331
116179966,0cyclictest329-21hwrng12:11:071
116179966,0cyclictest329-21hwrng09:38:321
116179966,0cyclictest329-21hwrng09:31:231
116179966,0cyclictest329-21hwrng09:31:231
116179966,0cyclictest329-21hwrng08:25:511
116179965,1cyclictest702-21snmpd11:05:351
116179965,1cyclictest702-21snmpd09:57:331
116179965,1cyclictest702-21snmpd09:10:361
116179964,2cyclictest702-21snmpd10:37:401
116179964,2cyclictest702-21snmpd08:33:511
116179960,3cyclictest27478-21idleruntime-cro09:05:011
116129966,0cyclictest702-21snmpd12:19:130
116129966,0cyclictest702-21snmpd08:17:470
116309955,0cyclictest329-21hwrng11:59:523
116309954,1cyclictest702-21snmpd11:24:573
116179955,0cyclictest702-21snmpd12:17:041
116179955,0cyclictest702-21snmpd12:08:581
116179955,0cyclictest702-21snmpd10:19:431
116179955,0cyclictest702-21snmpd09:08:311
116179955,0cyclictest329-21hwrng08:50:251
116179955,0cyclictest329-21hwrng08:05:211
116179954,1cyclictest702-21snmpd07:16:211
116179953,2cyclictest22754-21apt-get07:35:121
116179952,2cyclictest702-21snmpd11:55:011
116129955,0cyclictest702-21snmpd08:53:340
116129955,0cyclictest702-21snmpd08:37:150
116129954,1cyclictest702-21snmpd12:20:250
116129954,1cyclictest702-21snmpd11:50:540
116129954,1cyclictest702-21snmpd10:56:140
116129954,1cyclictest702-21snmpd09:15:410
116129954,1cyclictest702-21snmpd07:43:340
116129954,1cyclictest11216-21head11:00:140
116129953,2cyclictest25414-21ntpq10:15:190
116309944,0cyclictest329-21hwrng10:35:533
116309943,1cyclictest702-21snmpd07:36:273
116309943,1cyclictest3498-21ntpq12:00:183
116309940,4cyclictest23428-21turbostat08:59:563
116179944,0cyclictest702-21snmpd12:30:261
116179944,0cyclictest329-21hwrng12:27:311
116179944,0cyclictest329-21hwrng12:21:221
116179944,0cyclictest329-21hwrng11:15:501
116179944,0cyclictest329-21hwrng10:45:071
116179944,0cyclictest329-21hwrng10:31:481
116179944,0cyclictest14195-21apt-key07:15:011
116179943,1cyclictest702-21snmpd11:35:211
116179943,1cyclictest702-21snmpd07:21:321
116179943,1cyclictest3111-21gltestperf12:00:161
116179942,2cyclictest702-21snmpd08:55:271
116179942,2cyclictest29428-21cpuspeed_turbos07:50:101
116179942,2cyclictest27708-21ntpq07:45:161
116179942,2cyclictest23780-21ntpq11:30:161
116179942,2cyclictest23372-21ntpq10:10:181
116179942,2cyclictest21276-21fw_packets11:25:141
116179942,2cyclictest19466-21ntpq07:25:171
116179942,2cyclictest15769-21ntp_states11:10:171
116129944,0cyclictest702-21snmpd12:05:190
116129944,0cyclictest702-21snmpd09:00:010
116129944,0cyclictest702-21snmpd08:13:100
116129944,0cyclictest329-21hwrng10:22:350
116129943,1cyclictest702-21snmpd09:25:340
116129943,1cyclictest702-21snmpd08:58:300
116129943,1cyclictest0-21swapper/009:30:160
116129943,1cyclictest0-21swapper/009:30:160
116129942,2cyclictest29364-21perl11:45:130
116129942,2cyclictest13493-21sed07:10:210
116129940,2cyclictest18963-21apt08:45:000
116129940,1cyclictest7573-21ntpq12:10:170
116129940,1cyclictest0-21swapper/008:45:110
116309932,1cyclictest29747-21cat07:50:123
116179933,0cyclictest329-21hwrng08:40:101
116179932,1cyclictest702-21snmpd11:40:031
116179932,1cyclictest27474-21cat10:20:151
116179932,1cyclictest0-21swapper/107:40:131
116179931,2cyclictest18409-21cut12:35:191
116179930,3cyclictest21612-21smartctl07:30:191
116179930,2cyclictest977-21taskset08:00:151
116129933,0cyclictest0-21swapper/010:10:160
116129932,1cyclictest151ktimers/007:55:170
116129931,2cyclictest30331-21memory09:10:150
116129930,1cyclictest9379-21fschecks_time08:20:150
116129930,1cyclictest171rcu_preempt12:30:170
116129930,1cyclictest171rcu_preempt12:25:180
116129930,1cyclictest171rcu_preempt08:05:180
116129930,1cyclictest0-21swapper/011:15:150
116129930,1cyclictest0-21swapper/008:30:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional