You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-16 - 09:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Tue Sep 16, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23191994242,0cyclictest30076-21fwupd22:01:261
23195991918,1cyclictest60250irq/125-lan20:30:162
23195991918,1cyclictest60250irq/125-lan19:55:122
23195991817,1cyclictest60250irq/125-lan22:45:212
23195991817,1cyclictest60250irq/125-lan22:30:192
23195991817,1cyclictest60250irq/125-lan22:15:152
23195991817,1cyclictest60250irq/125-lan20:50:202
23195991717,0cyclictest60250irq/125-lan00:25:232
23195991717,0cyclictest60250irq/125-lan00:04:162
23195991716,1cyclictest60250irq/125-lan23:20:122
23195991716,1cyclictest60250irq/125-lan22:00:182
23195991716,1cyclictest60250irq/125-lan21:30:002
23195991716,1cyclictest60250irq/125-lan21:22:442
23195991716,1cyclictest60250irq/125-lan20:05:142
23195991716,1cyclictest60250irq/125-lan00:20:142
23195991616,0cyclictest60250irq/125-lan23:27:172
23195991616,0cyclictest60250irq/125-lan23:17:392
23195991616,0cyclictest60250irq/125-lan22:12:212
23195991616,0cyclictest60250irq/125-lan20:20:152
23195991616,0cyclictest60250irq/125-lan20:17:512
23195991615,1cyclictest60250irq/125-lan23:45:112
23195991615,1cyclictest60250irq/125-lan23:30:152
23195991615,1cyclictest60250irq/125-lan23:10:212
23195991615,1cyclictest60250irq/125-lan23:00:142
23195991615,1cyclictest60250irq/125-lan22:55:182
23195991615,1cyclictest60250irq/125-lan22:50:182
23195991615,1cyclictest60250irq/125-lan22:25:132
23195991615,1cyclictest60250irq/125-lan21:13:162
23195991615,1cyclictest60250irq/125-lan21:00:132
23195991615,1cyclictest60250irq/125-lan20:25:142
23195991615,1cyclictest60250irq/125-lan20:03:162
23195991615,1cyclictest60250irq/125-lan00:15:222
23195991515,0cyclictest60250irq/125-lan21:36:162
23195991515,0cyclictest60250irq/125-lan19:40:152
23195991515,0cyclictest60250irq/125-lan19:29:162
23195991514,1cyclictest60250irq/125-lan23:55:152
23195991514,1cyclictest60250irq/125-lan22:40:142
23195991514,1cyclictest60250irq/125-lan22:20:122
23195991514,1cyclictest60250irq/125-lan22:05:132
23195991514,1cyclictest60250irq/125-lan21:05:212
23195991514,1cyclictest60250irq/125-lan20:55:142
23195991514,1cyclictest60250irq/125-lan20:40:172
23195991514,1cyclictest60250irq/125-lan00:10:202
23195991414,0cyclictest60250irq/125-lan19:10:112
23195991413,1cyclictest60250irq/125-lan23:43:162
23195991413,1cyclictest60250irq/125-lan23:05:222
23195991413,1cyclictest60250irq/125-lan21:55:222
23195991413,1cyclictest60250irq/125-lan20:35:232
23195991413,1cyclictest60250irq/125-lan19:50:002
23195991313,0cyclictest60250irq/125-lan19:45:112
23195991313,0cyclictest60250irq/125-lan19:33:262
23195991312,1cyclictest60250irq/125-lan22:35:142
23195991312,1cyclictest60250irq/125-lan21:50:142
23195991312,1cyclictest60250irq/125-lan21:45:152
23195991312,1cyclictest60250irq/125-lan19:17:162
23195991312,1cyclictest60250irq/125-lan00:30:172
23195991312,1cyclictest60250irq/125-lan00:05:162
23191991313,0cyclictest329-21hwrng21:27:181
23184991313,0cyclictest329-21hwrng22:09:170
23184991313,0cyclictest329-21hwrng20:35:060
23200991212,0cyclictest329-21hwrng19:38:453
23195991212,0cyclictest60250irq/125-lan19:20:162
23184991212,0cyclictest329-21hwrng22:51:160
23184991212,0cyclictest329-21hwrng22:01:050
23184991212,0cyclictest329-21hwrng21:12:580
23184991212,0cyclictest329-21hwrng19:39:480
23195991111,0cyclictest60250irq/125-lan21:30:202
23195991110,1cyclictest60250irq/125-lan23:50:152
23195991110,1cyclictest60250irq/125-lan23:35:172
23195991110,1cyclictest60250irq/125-lan21:40:132
23184991111,0cyclictest329-21hwrng23:58:510
23200991010,0cyclictest329-21hwrng20:56:353
23200991010,0cyclictest329-21hwrng00:08:043
2319599109,1cyclictest60250irq/125-lan21:15:192
2319599109,1cyclictest60250irq/125-lan20:10:192
23184991010,0cyclictest329-21hwrng20:58:380
2318499100,8cyclictest25510-21turbostat20:34:590
232009999,0cyclictest329-21hwrng22:34:533
232009999,0cyclictest329-21hwrng21:51:533
232009999,0cyclictest329-21hwrng19:13:093
232009998,1cyclictest702-21snmpd20:38:013
231959999,0cyclictest60250irq/125-lan00:35:222
231959998,1cyclictest60250irq/125-lan20:45:182
231919996,2cyclictest702-21snmpd19:20:171
231849999,0cyclictest329-21hwrng21:07:520
231849999,0cyclictest329-21hwrng21:01:420
231849999,0cyclictest329-21hwrng19:55:080
231849999,0cyclictest329-21hwrng19:51:040
232009988,0cyclictest702-21snmpd21:43:243
232009988,0cyclictest329-21hwrng23:53:443
232009988,0cyclictest329-21hwrng23:49:383
232009988,0cyclictest329-21hwrng23:44:323
232009988,0cyclictest329-21hwrng23:39:243
232009988,0cyclictest329-21hwrng23:30:113
232009988,0cyclictest329-21hwrng23:25:043
232009988,0cyclictest329-21hwrng23:16:523
232009988,0cyclictest329-21hwrng22:20:343
232009988,0cyclictest329-21hwrng22:12:213
232009988,0cyclictest329-21hwrng21:23:133
232009988,0cyclictest329-21hwrng20:43:163
232009988,0cyclictest329-21hwrng20:11:313
232009988,0cyclictest329-21hwrng19:27:303
232009988,0cyclictest329-21hwrng19:22:223
232009988,0cyclictest329-21hwrng19:16:153
232009988,0cyclictest329-21hwrng00:25:293
232009988,0cyclictest329-21hwrng00:16:153
232009988,0cyclictest329-21hwrng00:12:113
232009987,1cyclictest329-21hwrng00:21:233
232009986,2cyclictest702-21snmpd21:57:003
232009986,2cyclictest702-21snmpd20:21:313
231919988,0cyclictest702-21snmpd19:48:241
231919988,0cyclictest329-21hwrng23:38:221
231919988,0cyclictest329-21hwrng22:31:491
231919988,0cyclictest329-21hwrng21:45:441
231919988,0cyclictest329-21hwrng21:42:401
231919988,0cyclictest329-21hwrng21:21:101
231919988,0cyclictest329-21hwrng20:55:331
231919988,0cyclictest329-21hwrng20:42:151
231919988,0cyclictest329-21hwrng20:27:541
231919988,0cyclictest329-21hwrng20:21:471
231919988,0cyclictest329-21hwrng00:06:011
231919986,2cyclictest702-21snmpd23:27:321
231919986,1cyclictest702-21snmpd23:33:141
231849988,0cyclictest702-21snmpd21:58:250
231849988,0cyclictest329-21hwrng21:35:290
231849988,0cyclictest329-21hwrng19:41:500
231849988,0cyclictest329-21hwrng00:14:120
231849986,2cyclictest702-21snmpd22:39:350
231849985,2cyclictest702-21snmpd23:00:160
232009977,0cyclictest702-21snmpd19:43:413
232009977,0cyclictest329-21hwrng23:55:483
232009977,0cyclictest329-21hwrng23:20:583
232009977,0cyclictest329-21hwrng23:12:473
232009977,0cyclictest329-21hwrng22:50:143
232009977,0cyclictest329-21hwrng22:37:573
232009977,0cyclictest329-21hwrng21:45:443
232009977,0cyclictest329-21hwrng21:30:223
232009977,0cyclictest329-21hwrng21:12:583
232009977,0cyclictest329-21hwrng20:30:593
232009977,0cyclictest329-21hwrng20:26:533
232009977,0cyclictest329-21hwrng20:19:433
232009977,0cyclictest329-21hwrng20:05:233
232009977,0cyclictest329-21hwrng20:03:203
232009977,0cyclictest329-21hwrng19:49:013
232009977,0cyclictest329-21hwrng19:30:353
232009977,0cyclictest329-21hwrng00:37:463
232009976,1cyclictest702-21snmpd21:29:353
232009976,1cyclictest702-21snmpd19:57:543
232009975,2cyclictest702-21snmpd22:17:343
231919977,0cyclictest702-21snmpd21:34:481
231919977,0cyclictest702-21snmpd19:40:171
231919977,0cyclictest329-21hwrng21:52:551
231919977,0cyclictest329-21hwrng20:30:591
231919977,0cyclictest329-21hwrng19:35:411
231919977,0cyclictest329-21hwrng00:31:381
231919976,1cyclictest702-21snmpd23:21:151
231919976,1cyclictest702-21snmpd00:19:181
231849977,0cyclictest702-21snmpd20:20:350
231849977,0cyclictest702-21snmpd20:11:480
231849977,0cyclictest702-21snmpd00:39:390
231849977,0cyclictest329-21hwrng23:07:390
231849977,0cyclictest329-21hwrng22:56:240
231849977,0cyclictest329-21hwrng22:41:030
231849976,1cyclictest702-21snmpd23:46:230
231849976,1cyclictest702-21snmpd23:13:180
231849976,1cyclictest702-21snmpd22:26:080
231849976,1cyclictest702-21snmpd00:32:070
231849976,1cyclictest151ktimers/021:31:250
231849975,2cyclictest702-21snmpd19:46:210
231849975,2cyclictest702-21snmpd00:01:390
231849970,7cyclictest0-21swapper/020:07:270
232009966,0cyclictest702-21snmpd23:01:123
232009966,0cyclictest702-21snmpd22:42:213
232009966,0cyclictest329-21hwrng22:49:133
232009966,0cyclictest329-21hwrng22:00:043
232009966,0cyclictest329-21hwrng19:50:013
232009966,0cyclictest329-21hwrng00:31:373
232009966,0cyclictest329-21hwrng00:05:003
232009965,1cyclictest702-21snmpd22:05:263
232009965,1cyclictest5952-21cat21:05:153
231959965,1cyclictest1509-21cat19:35:142
231919966,0cyclictest702-21snmpd23:50:041
231919966,0cyclictest329-21hwrng22:49:131
231919966,0cyclictest329-21hwrng20:53:311
231919966,0cyclictest329-21hwrng20:49:251
231919966,0cyclictest329-21hwrng00:05:011
231919965,1cyclictest702-21snmpd22:27:171
231919965,1cyclictest702-21snmpd21:03:201
231919965,1cyclictest702-21snmpd19:10:011
231919960,3cyclictest26341-21turbostat23:15:011
231849966,0cyclictest702-21snmpd23:54:250
231849966,0cyclictest702-21snmpd21:15:590
231849966,0cyclictest329-21hwrng21:40:380
231849965,1cyclictest702-21snmpd23:30:410
231849965,1cyclictest702-21snmpd22:18:100
231849965,1cyclictest702-21snmpd21:53:480
231849965,1cyclictest702-21snmpd21:23:180
231849965,1cyclictest702-21snmpd20:01:120
231849965,1cyclictest702-21snmpd19:29:170
231849965,1cyclictest151ktimers/020:40:250
231849960,6cyclictest0-21swapper/023:41:250
231849960,6cyclictest0-21swapper/022:31:250
231849960,6cyclictest0-21swapper/021:25:250
231849960,6cyclictest0-21swapper/020:49:250
231849960,6cyclictest0-21swapper/020:25:250
231849960,6cyclictest0-21swapper/020:19:250
231849960,6cyclictest0-21swapper/019:19:260
231849960,1cyclictest818-21dump-pmu-power19:34:590
231849960,0cyclictest25588-21munin-run00:30:000
232009955,0cyclictest329-21hwrng22:27:433
232009955,0cyclictest329-21hwrng20:53:313
232009955,0cyclictest329-21hwrng20:49:253
231919955,0cyclictest702-21snmpd23:19:041
231919955,0cyclictest702-21snmpd22:50:291
231919955,0cyclictest702-21snmpd20:39:471
231919955,0cyclictest702-21snmpd20:05:341
231919955,0cyclictest329-21hwrng22:44:071
231919954,1cyclictest702-21snmpd23:05:031
231919954,1cyclictest702-21snmpd00:20:141
231919952,1cyclictest7279-21turbostat21:10:001
231849955,0cyclictest702-21snmpd23:35:100
231849955,0cyclictest702-21snmpd22:11:380
231849955,0cyclictest702-21snmpd19:22:090
231849955,0cyclictest329-21hwrng22:24:390
231849954,1cyclictest702-21snmpd23:19:460
231849954,1cyclictest702-21snmpd21:46:540
231849954,1cyclictest702-21snmpd00:15:120
231849954,1cyclictest151ktimers/019:14:260
231849954,1cyclictest151ktimers/000:21:250
231849954,1cyclictest151ktimers/000:07:250
232009944,0cyclictest702-21snmpd21:38:163
232009941,3cyclictest22740-21uniq23:05:153
231919944,0cyclictest5000-21needreboot22:20:141
231919944,0cyclictest329-21hwrng23:46:351
231919944,0cyclictest329-21hwrng23:40:261
231919944,0cyclictest329-21hwrng23:01:301
231919944,0cyclictest329-21hwrng22:38:591
231919944,0cyclictest329-21hwrng21:39:361
231919944,0cyclictest329-21hwrng21:10:551
231919944,0cyclictest329-21hwrng20:12:331
231919944,0cyclictest329-21hwrng19:55:081
231919944,0cyclictest329-21hwrng19:27:301
231919943,1cyclictest28670-21ntpq00:35:181
231919943,1cyclictest18876-21gltestperf22:55:141
231919943,1cyclictest18362-21needreboot20:15:151
231919942,2cyclictest702-21snmpd21:15:261
231919942,2cyclictest702-21snmpd00:25:221
231919942,2cyclictest26606-21cat21:55:181
231849940,4cyclictest0-21swapper/023:23:250
232009932,1cyclictest702-21snmpd22:55:543
232009932,1cyclictest680-21ntpd21:16:573
232009930,2cyclictest4222-21ld21:00:183
231919933,0cyclictest329-21hwrng19:30:341
231919932,1cyclictest702-21snmpd19:50:101
231919932,1cyclictest271ktimers/119:15:171
231919932,1cyclictest18029-21wc00:10:251
231919931,2cyclictest702-21snmpd22:13:261
231919931,2cyclictest2431-21sh22:15:131
231919931,2cyclictest11396-21cat23:55:191
231919930,3cyclictest12518-21ntpq20:00:181
231849932,1cyclictest151ktimers/022:49:250
231849931,2cyclictest32109-21fschecks_time20:50:180
231919920,2cyclictest702-21snmpd22:05:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional