You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 19:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Thu Nov 13, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22936994444,0cyclictest31169-21fwupd08:46:123
22933991918,1cyclictest60250irq/125-lan07:30:122
22933991818,0cyclictest60250irq/125-lan11:53:262
22933991818,0cyclictest60250irq/125-lan10:50:192
22933991818,0cyclictest60250irq/125-lan10:30:022
22933991818,0cyclictest60250irq/125-lan07:27:142
22933991818,0cyclictest23606-21cat07:10:182
22933991817,1cyclictest60250irq/125-lan12:35:192
22933991817,1cyclictest60250irq/125-lan12:05:182
22933991717,0cyclictest60250irq/125-lan11:56:022
22933991717,0cyclictest60250irq/125-lan10:25:342
22933991717,0cyclictest60250irq/125-lan09:25:202
22933991717,0cyclictest60250irq/125-lan09:00:152
22933991717,0cyclictest60250irq/125-lan08:52:142
22933991717,0cyclictest60250irq/125-lan07:45:152
22933991716,1cyclictest60250irq/125-lan10:35:132
22933991616,0cyclictest60250irq/125-lan11:35:502
22933991616,0cyclictest60250irq/125-lan11:31:412
22933991616,0cyclictest60250irq/125-lan11:20:222
22933991616,0cyclictest60250irq/125-lan10:23:292
22933991616,0cyclictest60250irq/125-lan10:15:162
22933991616,0cyclictest60250irq/125-lan09:50:152
22933991616,0cyclictest60250irq/125-lan09:40:142
22933991616,0cyclictest60250irq/125-lan08:05:192
22933991615,1cyclictest60250irq/125-lan10:45:132
22933991615,1cyclictest60250irq/125-lan09:30:132
22933991615,1cyclictest60250irq/125-lan09:20:132
22933991615,1cyclictest60250irq/125-lan07:35:212
22933991515,0cyclictest60250irq/125-lan12:15:212
22933991515,0cyclictest60250irq/125-lan11:08:412
22933991515,0cyclictest60250irq/125-lan09:05:212
22933991515,0cyclictest60250irq/125-lan08:20:122
22933991515,0cyclictest60250irq/125-lan08:10:172
22933991515,0cyclictest60250irq/125-lan07:50:132
22933991514,1cyclictest60250irq/125-lan12:25:192
22933991514,1cyclictest60250irq/125-lan12:10:152
22933991514,1cyclictest60250irq/125-lan11:15:162
22933991514,1cyclictest60250irq/125-lan07:20:132
22928991515,0cyclictest329-21hwrng12:04:580
22928991515,0cyclictest329-21hwrng11:59:520
22928991515,0cyclictest329-21hwrng11:36:190
22928991515,0cyclictest329-21hwrng10:08:150
22928991515,0cyclictest329-21hwrng09:58:000
22928991515,0cyclictest329-21hwrng09:52:530
22928991515,0cyclictest329-21hwrng09:47:460
22928991515,0cyclictest329-21hwrng09:42:390
22928991515,0cyclictest329-21hwrng07:55:070
22928991515,0cyclictest329-21hwrng07:48:590
22933991414,0cyclictest60250irq/125-lan11:45:152
22933991414,0cyclictest60250irq/125-lan11:25:202
22933991414,0cyclictest60250irq/125-lan11:01:012
22933991414,0cyclictest60250irq/125-lan10:05:462
22933991414,0cyclictest60250irq/125-lan09:35:232
22933991414,0cyclictest60250irq/125-lan08:40:282
22933991414,0cyclictest60250irq/125-lan07:40:222
22933991414,0cyclictest60250irq/125-lan07:15:122
22933991413,1cyclictest60250irq/125-lan09:45:182
22933991413,1cyclictest60250irq/125-lan08:30:192
22933991413,1cyclictest60250irq/125-lan08:25:172
22933991413,1cyclictest60250irq/125-lan08:15:172
22928991414,0cyclictest702-21snmpd07:42:410
22928991414,0cyclictest329-21hwrng09:38:330
22928991414,0cyclictest329-21hwrng09:26:160
22928991414,0cyclictest329-21hwrng09:24:130
22928991414,0cyclictest329-21hwrng09:18:040
22928991414,0cyclictest329-21hwrng09:06:490
22928991414,0cyclictest329-21hwrng08:57:360
22928991414,0cyclictest329-21hwrng08:06:240
22928991414,0cyclictest329-21hwrng07:51:020
22928991414,0cyclictest329-21hwrng07:39:450
22928991414,0cyclictest329-21hwrng07:32:360
22928991414,0cyclictest329-21hwrng07:29:320
22933991313,0cyclictest60250irq/125-lan12:20:122
22933991313,0cyclictest60250irq/125-lan11:40:112
22933991313,0cyclictest60250irq/125-lan08:45:132
22933991312,1cyclictest60250irq/125-lan12:30:162
22933991312,1cyclictest60250irq/125-lan10:10:122
22933991312,1cyclictest60250irq/125-lan08:55:112
22928991313,0cyclictest329-21hwrng10:35:540
22928991313,0cyclictest329-21hwrng10:10:180
22928991313,0cyclictest329-21hwrng08:24:500
22936991212,0cyclictest329-21hwrng10:48:113
22933991212,0cyclictest60250irq/125-lan12:01:422
22933991212,0cyclictest60250irq/125-lan07:55:132
22933991211,1cyclictest60250irq/125-lan08:35:182
22930991212,0cyclictest329-21hwrng11:43:291
22928991212,0cyclictest329-21hwrng11:40:240
22928991212,0cyclictest329-21hwrng08:48:230
22933991111,0cyclictest60250irq/125-lan09:17:162
22933991111,0cyclictest60250irq/125-lan09:10:562
22933991111,0cyclictest329-21hwrng10:03:082
22933991110,1cyclictest60250irq/125-lan08:00:152
22928991111,0cyclictest329-21hwrng12:09:050
22928991010,0cyclictest329-21hwrng11:30:090
22928991010,0cyclictest329-21hwrng10:20:320
22928991010,0cyclictest329-21hwrng08:29:560
229339999,0cyclictest60250irq/125-lan10:40:152
229289999,0cyclictest329-21hwrng12:23:250
229289999,0cyclictest329-21hwrng11:52:420
229289999,0cyclictest329-21hwrng11:46:320
229289999,0cyclictest329-21hwrng10:30:460
229289999,0cyclictest329-21hwrng10:25:390
229289999,0cyclictest329-21hwrng08:50:250
229289999,0cyclictest329-21hwrng08:37:070
229289999,0cyclictest329-21hwrng08:32:000
229289999,0cyclictest329-21hwrng08:16:380
229289999,0cyclictest329-21hwrng08:12:310
229289998,1cyclictest702-21snmpd11:03:350
229369988,0cyclictest702-21snmpd12:01:293
229369988,0cyclictest702-21snmpd08:44:013
229369988,0cyclictest329-21hwrng12:31:363
229369988,0cyclictest329-21hwrng11:38:213
229369988,0cyclictest329-21hwrng10:39:593
229369988,0cyclictest329-21hwrng10:10:173
229369988,0cyclictest329-21hwrng09:51:523
229369988,0cyclictest329-21hwrng08:07:243
229369988,0cyclictest329-21hwrng07:58:123
229369988,0cyclictest329-21hwrng07:54:053
229369988,0cyclictest329-21hwrng07:45:553
229369987,1cyclictest702-21snmpd10:00:403
229339988,0cyclictest60250irq/125-lan11:10:182
229309988,0cyclictest702-21snmpd12:38:121
229309988,0cyclictest702-21snmpd12:21:591
229309988,0cyclictest702-21snmpd09:47:181
229309988,0cyclictest702-21snmpd08:16:161
229309988,0cyclictest702-21snmpd08:12:211
229309988,0cyclictest700-21lldpd10:57:561
229309988,0cyclictest329-21hwrng12:14:121
229309988,0cyclictest329-21hwrng11:07:381
229309988,0cyclictest329-21hwrng10:12:211
229309988,0cyclictest329-21hwrng09:30:221
229309988,0cyclictest329-21hwrng08:50:251
229289988,0cyclictest329-21hwrng11:28:070
229289988,0cyclictest329-21hwrng11:21:580
229289988,0cyclictest329-21hwrng10:53:180
229289988,0cyclictest329-21hwrng10:47:090
229289988,0cyclictest329-21hwrng10:41:010
229289988,0cyclictest329-21hwrng09:00:400
229289988,0cyclictest329-21hwrng08:41:120
229289988,0cyclictest329-21hwrng08:01:160
229289988,0cyclictest329-21hwrng07:24:240
229289988,0cyclictest329-21hwrng07:10:040
229369977,0cyclictest702-21snmpd10:56:493
229369977,0cyclictest702-21snmpd08:37:123
229369977,0cyclictest329-21hwrng12:36:443
229369977,0cyclictest329-21hwrng12:28:323
229369977,0cyclictest329-21hwrng12:22:233
229369977,0cyclictest329-21hwrng12:09:053
229369977,0cyclictest329-21hwrng11:56:473
229369977,0cyclictest329-21hwrng11:25:033
229369977,0cyclictest329-21hwrng11:02:313
229369977,0cyclictest329-21hwrng10:30:473
229369977,0cyclictest329-21hwrng10:16:263
229369977,0cyclictest329-21hwrng10:07:133
229369977,0cyclictest329-21hwrng09:56:583
229369977,0cyclictest329-21hwrng09:41:363
229369977,0cyclictest329-21hwrng09:25:133
229369977,0cyclictest329-21hwrng09:10:533
229369977,0cyclictest329-21hwrng09:05:473
229369977,0cyclictest329-21hwrng09:00:403
229369977,0cyclictest329-21hwrng08:56:333
229369977,0cyclictest329-21hwrng08:21:443
229369977,0cyclictest329-21hwrng08:11:313
229369977,0cyclictest329-21hwrng07:42:513
229369977,0cyclictest329-21hwrng07:37:423
229369977,0cyclictest329-21hwrng07:28:303
229369977,0cyclictest329-21hwrng07:21:193
229369976,1cyclictest702-21snmpd10:40:043
229369976,1cyclictest702-21snmpd07:16:113
229339977,0cyclictest702-21snmpd09:58:392
229339976,1cyclictest22885-21kworker/2:0+events10:55:202
229309977,0cyclictest702-21snmpd10:15:311
229309977,0cyclictest702-21snmpd10:09:371
229309977,0cyclictest702-21snmpd10:03:431
229309977,0cyclictest702-21snmpd07:44:091
229309977,0cyclictest702-21snmpd07:36:551
229309977,0cyclictest702-21snmpd07:18:261
229309977,0cyclictest329-21hwrng12:16:141
229309977,0cyclictest329-21hwrng12:08:031
229309977,0cyclictest329-21hwrng11:57:491
229309977,0cyclictest329-21hwrng11:47:341
229309977,0cyclictest329-21hwrng11:33:141
229309977,0cyclictest329-21hwrng11:27:061
229309977,0cyclictest329-21hwrng11:20:571
229309977,0cyclictest329-21hwrng11:15:501
229309977,0cyclictest329-21hwrng11:11:441
229309977,0cyclictest329-21hwrng11:03:331
229309977,0cyclictest329-21hwrng10:44:051
229309977,0cyclictest329-21hwrng10:22:351
229309977,0cyclictest329-21hwrng09:40:361
229309977,0cyclictest329-21hwrng09:39:351
229309977,0cyclictest329-21hwrng08:09:281
229309977,0cyclictest329-21hwrng07:13:091
229309976,1cyclictest702-21snmpd10:36:381
229309976,1cyclictest702-21snmpd09:05:231
229309976,1cyclictest702-21snmpd08:41:241
229309976,1cyclictest702-21snmpd07:26:141
229289977,0cyclictest702-21snmpd12:17:200
229289977,0cyclictest702-21snmpd10:55:080
229289977,0cyclictest702-21snmpd09:30:300
229289976,1cyclictest702-21snmpd12:25:410
229289976,1cyclictest702-21snmpd11:07:000
229369966,0cyclictest702-21snmpd09:46:453
229369966,0cyclictest329-21hwrng12:11:083
229369966,0cyclictest329-21hwrng11:51:403
229369966,0cyclictest329-21hwrng11:45:323
229369966,0cyclictest329-21hwrng11:20:573
229369966,0cyclictest329-21hwrng11:15:503
229369966,0cyclictest329-21hwrng11:08:403
229369966,0cyclictest329-21hwrng10:52:173
229369966,0cyclictest329-21hwrng09:36:303
229369966,0cyclictest329-21hwrng09:31:233
229369966,0cyclictest329-21hwrng09:21:093
229369966,0cyclictest329-21hwrng09:16:013
229369966,0cyclictest329-21hwrng08:53:303
229369966,0cyclictest329-21hwrng08:30:583
229369966,0cyclictest329-21hwrng07:33:383
229369965,1cyclictest702-21snmpd11:34:133
229369965,1cyclictest702-21snmpd08:29:133
229369965,1cyclictest17809-21needreboot08:15:163
229309966,0cyclictest702-21snmpd12:03:411
229309966,0cyclictest329-21hwrng08:36:051
229309966,0cyclictest329-21hwrng07:30:331
229309965,1cyclictest702-21snmpd12:32:151
229309965,1cyclictest702-21snmpd10:46:201
229309965,1cyclictest702-21snmpd08:57:581
229309965,1cyclictest702-21snmpd07:51:111
229309964,2cyclictest19611-21cat08:20:141
229289965,1cyclictest702-21snmpd10:15:060
229369955,0cyclictest329-21hwrng11:40:243
229369955,0cyclictest329-21hwrng11:10:433
229369955,0cyclictest329-21hwrng10:27:413
229369955,0cyclictest329-21hwrng10:20:323
229309955,0cyclictest702-21snmpd09:12:161
229309955,0cyclictest329-21hwrng11:54:451
229309954,1cyclictest702-21snmpd09:29:151
229309954,1cyclictest702-21snmpd08:47:431
229309954,1cyclictest702-21snmpd07:20:221
229309953,2cyclictest680-21ntpd08:01:571
229309953,2cyclictest5706-21ntpq07:45:161
229309953,2cyclictest26426-21ntpq09:55:161
229309950,3cyclictest23383-21dump-pmu-power08:29:591
229369944,0cyclictest329-21hwrng08:00:153
229309944,0cyclictest329-21hwrng09:50:501
229309944,0cyclictest329-21hwrng09:16:011
229309944,0cyclictest329-21hwrng09:03:441
229309943,1cyclictest0-21swapper/107:55:131
229309942,2cyclictest702-21snmpd10:27:081
229289944,0cyclictest329-21hwrng12:13:100
229289944,0cyclictest329-21hwrng09:11:560
229289942,2cyclictest27825-21fw_conntrack11:15:120
229289942,2cyclictest25943-21ntpq07:15:180
229289940,1cyclictest28733-21grep10:00:180
229289940,1cyclictest25987-21cat12:30:140
229369932,1cyclictest0-21swapper/307:10:203
229369930,3cyclictest0-21swapper/312:15:143
229309932,1cyclictest702-21snmpd10:30:051
229309932,1cyclictest271ktimers/111:36:071
229309932,1cyclictest23974-21cat12:25:161
229309932,1cyclictest12527-21wc09:20:191
229309930,2cyclictest16510-21/usr/sbin/munin10:50:121
229289932,1cyclictest0-21swapper/012:35:150
229289930,0cyclictest0-21swapper/011:10:010
229309921,1cyclictest271ktimers/108:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional