You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 04:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Mon May 05, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5357991918,1cyclictest60250irq/125-lan23:24:202
5357991918,1cyclictest60250irq/125-lan23:06:542
5357991918,1cyclictest60250irq/125-lan22:14:062
5357991918,1cyclictest60250irq/125-lan00:09:422
5357991818,0cyclictest60250irq/125-lan23:45:102
5357991818,0cyclictest60250irq/125-lan23:38:582
5357991818,0cyclictest60250irq/125-lan22:30:032
5357991818,0cyclictest60250irq/125-lan21:17:222
5357991818,0cyclictest60250irq/125-lan20:10:212
5357991817,1cyclictest60250irq/125-lan23:40:152
5357991817,1cyclictest60250irq/125-lan22:35:222
5357991817,1cyclictest60250irq/125-lan22:26:242
5357991817,1cyclictest60250irq/125-lan21:34:552
5357991817,1cyclictest60250irq/125-lan20:50:202
5357991817,1cyclictest60250irq/125-lan00:10:502
5357991717,0cyclictest60250irq/125-lan23:55:272
5357991717,0cyclictest60250irq/125-lan21:45:252
5357991717,0cyclictest60250irq/125-lan21:39:552
5357991717,0cyclictest60250irq/125-lan21:10:182
5357991717,0cyclictest60250irq/125-lan00:35:172
5357991717,0cyclictest60250irq/125-lan00:27:392
5357991716,1cyclictest60250irq/125-lan23:25:232
5357991716,1cyclictest60250irq/125-lan23:14:532
5357991716,1cyclictest60250irq/125-lan22:55:212
5357991716,1cyclictest60250irq/125-lan22:53:572
5357991716,1cyclictest60250irq/125-lan22:48:152
5357991716,1cyclictest60250irq/125-lan22:05:302
5357991716,1cyclictest60250irq/125-lan22:01:512
5357991716,1cyclictest60250irq/125-lan21:43:322
5357991716,1cyclictest60250irq/125-lan21:26:222
5357991716,1cyclictest60250irq/125-lan21:20:202
5357991716,1cyclictest60250irq/125-lan20:30:232
5357991716,1cyclictest60250irq/125-lan20:05:192
5357991716,1cyclictest60250irq/125-lan19:25:162
5357991716,1cyclictest60250irq/125-lan00:33:262
5357991716,1cyclictest60250irq/125-lan00:24:162
5357991716,1cyclictest60250irq/125-lan00:15:192
5357991715,2cyclictest60250irq/125-lan20:20:162
5357991715,1cyclictest60250irq/125-lan23:33:082
5357991616,0cyclictest60250irq/125-lan20:55:222
5357991615,1cyclictest60250irq/125-lan23:54:422
5357991615,1cyclictest60250irq/125-lan23:15:162
5357991615,1cyclictest60250irq/125-lan23:02:162
5357991615,1cyclictest60250irq/125-lan22:40:312
5357991615,1cyclictest60250irq/125-lan22:23:502
5357991615,1cyclictest60250irq/125-lan21:58:282
5357991615,1cyclictest60250irq/125-lan21:50:192
5357991615,1cyclictest60250irq/125-lan20:00:202
5357991615,1cyclictest60250irq/125-lan19:20:182
5357991615,1cyclictest60250irq/125-lan00:00:172
5357991515,0cyclictest60250irq/125-lan20:15:192
5357991514,1cyclictest60250irq/125-lan22:16:042
5357991514,1cyclictest60250irq/125-lan21:05:002
5357991514,1cyclictest60250irq/125-lan20:25:172
5357991514,1cyclictest60250irq/125-lan19:30:192
5350991515,0cyclictest329-21hwrng19:42:210
5360991414,0cyclictest329-21hwrng21:50:213
5357991414,0cyclictest60250irq/125-lan19:40:162
5357991414,0cyclictest60250irq/125-lan19:35:132
5357991413,1cyclictest60250irq/125-lan19:50:152
5350991414,0cyclictest702-21snmpd23:46:490
5350991414,0cyclictest329-21hwrng23:24:320
5350991414,0cyclictest329-21hwrng21:52:230
5350991414,0cyclictest329-21hwrng21:42:100
5350991414,0cyclictest329-21hwrng19:54:380
5350991414,0cyclictest329-21hwrng00:16:470
5350991414,0cyclictest15920-21cat19:35:160
5360991313,0cyclictest329-21hwrng23:07:093
5360991313,0cyclictest329-21hwrng20:45:493
5357991313,0cyclictest60250irq/125-lan19:10:162
5350991313,0cyclictest702-21snmpd00:07:450
5360991212,0cyclictest329-21hwrng23:55:173
5360991212,0cyclictest329-21hwrng22:45:383
5360991212,0cyclictest329-21hwrng22:27:133
5360991212,0cyclictest329-21hwrng22:17:593
5360991212,0cyclictest329-21hwrng21:45:133
5360991212,0cyclictest329-21hwrng21:23:443
5360991212,0cyclictest329-21hwrng00:32:073
5357991211,1cyclictest60250irq/125-lan21:00:172
5353991212,0cyclictest329-21hwrng23:02:011
5350991212,0cyclictest329-21hwrng23:58:210
5350991212,0cyclictest329-21hwrng23:10:130
5360991111,0cyclictest329-21hwrng23:25:353
5360991111,0cyclictest329-21hwrng23:11:153
5360991111,0cyclictest329-21hwrng22:03:393
5357991110,1cyclictest60250irq/125-lan20:35:202
5357991110,1cyclictest60250irq/125-lan19:45:152
5350991111,0cyclictest329-21hwrng22:52:480
5350991111,0cyclictest329-21hwrng22:31:180
5350991111,0cyclictest329-21hwrng22:19:000
5350991111,0cyclictest329-21hwrng00:30:060
5360991010,0cyclictest329-21hwrng23:41:583
5360991010,0cyclictest329-21hwrng00:28:033
535799109,1cyclictest60250irq/125-lan20:40:232
535799109,1cyclictest60250irq/125-lan19:15:172
5357991010,0cyclictest60250irq/125-lan20:45:142
5350991010,0cyclictest329-21hwrng22:49:450
5350991010,0cyclictest329-21hwrng21:30:530
5350991010,0cyclictest329-21hwrng21:26:480
5350991010,0cyclictest329-21hwrng21:24:440
53609999,0cyclictest329-21hwrng23:53:143
53609999,0cyclictest329-21hwrng23:35:493
53609999,0cyclictest329-21hwrng22:13:533
53609999,0cyclictest329-21hwrng21:42:093
53609999,0cyclictest329-21hwrng21:05:183
53609999,0cyclictest329-21hwrng19:52:363
53609999,0cyclictest329-21hwrng19:40:173
53609999,0cyclictest329-21hwrng00:12:413
53609999,0cyclictest329-21hwrng00:08:353
53579998,1cyclictest60250irq/125-lan19:55:122
53509999,0cyclictest329-21hwrng23:27:380
53509999,0cyclictest329-21hwrng22:23:060
53509999,0cyclictest329-21hwrng20:39:410
53509999,0cyclictest329-21hwrng19:17:460
53509999,0cyclictest329-21hwrng00:29:040
53609988,0cyclictest702-21snmpd19:23:143
53609988,0cyclictest329-21hwrng23:24:333
53609988,0cyclictest329-21hwrng22:56:553
53609988,0cyclictest329-21hwrng21:34:593
53609988,0cyclictest329-21hwrng20:50:583
53609988,0cyclictest329-21hwrng20:11:013
53609988,0cyclictest329-21hwrng19:34:093
53539988,0cyclictest702-21snmpd21:29:441
53539988,0cyclictest702-21snmpd21:21:081
53539988,0cyclictest702-21snmpd20:30:111
53539988,0cyclictest329-21hwrng23:16:221
53539988,0cyclictest329-21hwrng23:12:161
53539988,0cyclictest329-21hwrng22:44:371
53539988,0cyclictest329-21hwrng22:38:291
53539988,0cyclictest329-21hwrng22:33:211
53539988,0cyclictest329-21hwrng22:25:101
53539988,0cyclictest329-21hwrng22:15:561
53539988,0cyclictest329-21hwrng22:00:341
53539988,0cyclictest329-21hwrng21:46:141
53539988,0cyclictest329-21hwrng21:37:021
53539988,0cyclictest329-21hwrng21:17:341
53539988,0cyclictest329-21hwrng00:05:301
53509988,0cyclictest329-21hwrng00:13:430
53509987,1cyclictest702-21snmpd19:45:580
53509980,6cyclictest24608-21turbostat23:54:590
53609977,0cyclictest702-21snmpd22:41:293
53609977,0cyclictest702-21snmpd19:55:463
53609977,0cyclictest702-21snmpd00:21:443
53609977,0cyclictest329-21hwrng23:49:073
53609977,0cyclictest329-21hwrng23:34:473
53609977,0cyclictest329-21hwrng22:08:473
53609977,0cyclictest329-21hwrng20:35:363
53609977,0cyclictest329-21hwrng20:25:213
53609977,0cyclictest329-21hwrng20:20:143
53609977,0cyclictest329-21hwrng20:19:123
53609977,0cyclictest329-21hwrng19:45:253
53609977,0cyclictest329-21hwrng19:35:113
53609977,0cyclictest329-21hwrng19:25:573
53609977,0cyclictest329-21hwrng19:19:503
53609976,1cyclictest702-21snmpd22:50:113
53609976,1cyclictest702-21snmpd21:36:083
53609976,1cyclictest702-21snmpd21:04:033
53609976,1cyclictest702-21snmpd20:04:203
53609975,2cyclictest702-21snmpd00:03:063
53539977,0cyclictest702-21snmpd22:48:251
53539977,0cyclictest702-21snmpd21:31:401
53539977,0cyclictest329-21hwrng23:52:111
53539977,0cyclictest329-21hwrng23:45:021
53539977,0cyclictest329-21hwrng23:30:421
53539977,0cyclictest329-21hwrng23:22:301
53539977,0cyclictest329-21hwrng22:55:531
53539977,0cyclictest329-21hwrng22:14:561
53539977,0cyclictest329-21hwrng22:07:461
53539977,0cyclictest329-21hwrng21:56:301
53539977,0cyclictest329-21hwrng21:10:251
53539977,0cyclictest329-21hwrng21:06:191
53539977,0cyclictest329-21hwrng21:00:101
53539977,0cyclictest329-21hwrng20:55:031
53539977,0cyclictest329-21hwrng20:26:231
53539977,0cyclictest329-21hwrng20:16:081
53539977,0cyclictest329-21hwrng20:00:461
53539977,0cyclictest329-21hwrng19:46:261
53539977,0cyclictest329-21hwrng19:43:221
53539977,0cyclictest329-21hwrng19:30:031
53539977,0cyclictest329-21hwrng19:29:021
53539977,0cyclictest329-21hwrng19:14:411
53539977,0cyclictest329-21hwrng00:39:181
53539977,0cyclictest329-21hwrng00:32:081
53539977,0cyclictest329-21hwrng00:22:551
53539977,0cyclictest329-21hwrng00:15:451
53539977,0cyclictest329-21hwrng00:14:441
53539977,0cyclictest329-21hwrng00:01:251
53539976,1cyclictest702-21snmpd20:54:221
53539976,1cyclictest702-21snmpd19:21:441
53509977,0cyclictest702-21snmpd22:07:290
53509977,0cyclictest702-21snmpd19:56:320
53509976,1cyclictest702-21snmpd21:37:280
53509976,1cyclictest702-21snmpd20:31:450
53609966,0cyclictest702-21snmpd20:07:153
53609966,0cyclictest329-21hwrng23:16:213
53609966,0cyclictest329-21hwrng22:36:263
53609966,0cyclictest329-21hwrng20:58:073
53609966,0cyclictest329-21hwrng20:40:423
53609966,0cyclictest329-21hwrng20:30:283
53609965,1cyclictest702-21snmpd22:31:033
53609965,1cyclictest702-21snmpd21:58:063
53609964,2cyclictest702-21snmpd23:02:193
53609964,2cyclictest702-21snmpd21:13:043
53539966,0cyclictest702-21snmpd23:36:531
53539966,0cyclictest702-21snmpd23:27:361
53539966,0cyclictest702-21snmpd19:57:231
53539966,0cyclictest329-21hwrng23:05:051
53539966,0cyclictest329-21hwrng22:54:521
53539966,0cyclictest329-21hwrng22:22:061
53539966,0cyclictest329-21hwrng21:53:251
53539966,0cyclictest329-21hwrng20:45:491
53539966,0cyclictest329-21hwrng20:40:431
53539966,0cyclictest329-21hwrng20:11:011
53539966,0cyclictest329-21hwrng20:10:001
53539966,0cyclictest329-21hwrng19:50:331
53539966,0cyclictest329-21hwrng19:36:131
53539966,0cyclictest329-21hwrng19:18:471
53539965,1cyclictest702-21snmpd21:44:481
53509966,0cyclictest702-21snmpd22:40:400
53509966,0cyclictest702-21snmpd21:16:190
53509966,0cyclictest702-21snmpd20:10:030
53509966,0cyclictest702-21snmpd20:09:030
53509966,0cyclictest702-21snmpd19:12:420
53509966,0cyclictest702-21snmpd00:37:470
53509965,1cyclictest702-21snmpd22:57:290
53609955,0cyclictest702-21snmpd21:25:313
53609954,1cyclictest702-21snmpd21:15:463
53539955,0cyclictest702-21snmpd20:22:151
53539955,0cyclictest329-21hwrng20:35:361
53539954,1cyclictest702-21snmpd23:44:101
53539954,1cyclictest23975-21sh00:29:161
53509955,0cyclictest702-21snmpd20:42:280
53509955,0cyclictest702-21snmpd20:21:150
53509955,0cyclictest702-21snmpd20:04:410
53509954,1cyclictest702-21snmpd21:48:290
53509950,1cyclictest30611gltestperf23:00:140
53609944,0cyclictest329-21hwrng22:21:043
53609944,0cyclictest329-21hwrng00:35:133
53609942,2cyclictest5978-21cat19:10:153
53539940,0cyclictest29531-21apt-get00:00:011
53509943,1cyclictest702-21snmpd23:07:040
53509943,1cyclictest702-21snmpd20:26:000
53509943,1cyclictest151ktimers/023:33:550
53509942,2cyclictest702-21snmpd20:54:030
53509942,2cyclictest2712-21fw_packets21:55:170
53509942,2cyclictest21783-21munin-run23:20:000
53509942,2cyclictest14647-21ssh23:44:410
53509942,2cyclictest0-21swapper/000:00:150
53509941,1cyclictest171rcu_preempt22:14:510
53509940,1cyclictest0-21swapper/021:10:170
53509940,0cyclictest0-21swapper/023:35:140
53609930,1cyclictest0-21swapper/300:15:033
53509932,1cyclictest702-21snmpd22:25:130
53509932,1cyclictest702-21snmpd19:27:100
53509932,1cyclictest13664-21df19:30:140
53509932,1cyclictest0-21swapper/000:20:160
53509931,2cyclictest19621-21acpi21:05:130
53509931,2cyclictest16028-21ntpq20:55:200
53509931,2cyclictest10389-21ssh22:35:120
53509931,0cyclictest171rcu_preempt21:00:250
53509930,1cyclictest171rcu_preempt22:00:530
53509921,1cyclictest702-21snmpd20:45:120
53509921,1cyclictest151ktimers/020:15:030
53509920,2cyclictest702-21snmpd19:20:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional