You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 02:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Wed Nov 26, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15408991918,1cyclictest60250irq/125-lan23:10:142
15408991918,1cyclictest60250irq/125-lan23:00:182
15408991818,0cyclictest60250irq/125-lan23:28:332
15408991818,0cyclictest60250irq/125-lan19:43:512
15408991817,1cyclictest60250irq/125-lan23:55:212
15408991817,1cyclictest60250irq/125-lan22:25:142
15408991817,1cyclictest60250irq/125-lan20:55:012
15408991817,1cyclictest60250irq/125-lan20:35:182
15408991717,0cyclictest60250irq/125-lan22:20:312
15408991717,0cyclictest60250irq/125-lan21:00:162
15408991717,0cyclictest60250irq/125-lan20:18:502
15408991717,0cyclictest60250irq/125-lan19:35:132
15408991716,1cyclictest60250irq/125-lan23:20:152
15408991716,1cyclictest60250irq/125-lan22:55:212
15408991716,1cyclictest60250irq/125-lan22:15:192
15408991716,1cyclictest60250irq/125-lan20:30:142
15408991716,1cyclictest60250irq/125-lan19:10:132
15408991616,0cyclictest60250irq/125-lan21:30:152
15408991615,1cyclictest60250irq/125-lan23:50:122
15408991615,1cyclictest60250irq/125-lan23:40:172
15408991615,1cyclictest60250irq/125-lan22:30:192
15408991615,1cyclictest60250irq/125-lan22:10:182
15408991615,1cyclictest60250irq/125-lan21:50:192
15408991615,1cyclictest60250irq/125-lan20:05:312
15408991615,1cyclictest60250irq/125-lan19:50:112
15408991615,1cyclictest60250irq/125-lan00:32:482
15408991615,1cyclictest60250irq/125-lan00:00:142
15412991515,0cyclictest329-21hwrng21:01:333
15408991515,0cyclictest60250irq/125-lan22:45:142
15408991515,0cyclictest60250irq/125-lan22:06:122
15408991515,0cyclictest60250irq/125-lan20:55:182
15408991515,0cyclictest60250irq/125-lan20:48:382
15408991515,0cyclictest60250irq/125-lan20:10:252
15408991515,0cyclictest60250irq/125-lan19:20:192
15408991515,0cyclictest60250irq/125-lan00:26:442
15408991515,0cyclictest60250irq/125-lan00:20:182
15408991514,1cyclictest60250irq/125-lan23:05:172
15408991514,1cyclictest60250irq/125-lan21:20:152
15408991514,1cyclictest60250irq/125-lan21:10:142
15408991514,1cyclictest60250irq/125-lan20:40:212
15408991514,1cyclictest60250irq/125-lan19:25:192
15408991414,0cyclictest60250irq/125-lan22:37:272
15408991414,0cyclictest60250irq/125-lan21:25:162
15408991413,1cyclictest60250irq/125-lan23:35:142
15408991413,1cyclictest60250irq/125-lan22:00:202
15408991413,1cyclictest60250irq/125-lan21:40:142
15408991413,1cyclictest60250irq/125-lan19:55:112
15408991413,1cyclictest60250irq/125-lan00:15:182
15408991413,1cyclictest60250irq/125-lan00:05:212
15403991412,0cyclictest329-21hwrng00:20:131
15408991312,1cyclictest60250irq/125-lan22:52:322
15408991312,1cyclictest60250irq/125-lan22:45:002
15408991312,1cyclictest60250irq/125-lan20:25:152
15408991312,1cyclictest60250irq/125-lan20:00:182
15403991313,0cyclictest702-21snmpd20:12:121
15403991313,0cyclictest329-21hwrng19:20:101
15403991313,0cyclictest329-21hwrng19:19:091
15408991212,0cyclictest60250irq/125-lan23:45:122
15408991212,0cyclictest60250irq/125-lan19:30:122
15408991212,0cyclictest60250irq/125-lan00:10:122
15408991211,1cyclictest60250irq/125-lan21:45:212
15408991211,1cyclictest60250irq/125-lan21:35:182
15408991211,1cyclictest60250irq/125-lan00:35:132
15403991212,0cyclictest329-21hwrng21:36:221
15403991212,0cyclictest329-21hwrng21:03:361
15403991212,0cyclictest329-21hwrng20:50:171
15403991212,0cyclictest329-21hwrng20:47:131
15403991212,0cyclictest329-21hwrng20:30:501
15403991212,0cyclictest329-21hwrng19:58:051
15408991111,0cyclictest60250irq/125-lan21:15:062
15408991110,1cyclictest60250irq/125-lan21:55:192
15403991111,0cyclictest329-21hwrng23:31:041
15403991111,0cyclictest329-21hwrng23:14:411
15403991111,0cyclictest329-21hwrng22:09:081
15403991111,0cyclictest329-21hwrng00:36:361
15403991111,0cyclictest329-21hwrng00:12:011
15403991010,0cyclictest329-21hwrng23:40:161
15403991010,0cyclictest329-21hwrng22:01:591
15403991010,0cyclictest329-21hwrng19:41:421
15403991010,0cyclictest329-21hwrng19:36:341
154089999,0cyclictest60250irq/125-lan21:05:202
154039999,0cyclictest329-21hwrng23:59:431
154039999,0cyclictest329-21hwrng20:39:011
154039998,1cyclictest702-21snmpd21:57:431
154129988,0cyclictest702-21snmpd22:15:363
154129987,1cyclictest702-21snmpd23:38:033
154089988,0cyclictest329-21hwrng19:45:462
154089987,1cyclictest60250irq/125-lan20:20:132
154039988,0cyclictest702-21snmpd21:41:031
154039988,0cyclictest702-21snmpd20:04:501
154039988,0cyclictest702-21snmpd00:08:411
154039988,0cyclictest329-21hwrng23:06:291
154039988,0cyclictest329-21hwrng21:25:071
154039988,0cyclictest329-21hwrng20:42:071
154039988,0cyclictest329-21hwrng20:26:451
154039987,1cyclictest702-21snmpd23:00:361
153989988,0cyclictest702-21snmpd21:45:210
153989988,0cyclictest702-21snmpd21:42:060
153989988,0cyclictest702-21snmpd21:36:320
153989988,0cyclictest702-21snmpd21:33:270
153989988,0cyclictest702-21snmpd21:05:190
153989988,0cyclictest702-21snmpd20:41:070
153989988,0cyclictest702-21snmpd19:58:090
153989988,0cyclictest702-21snmpd00:34:330
153989988,0cyclictest329-21hwrng23:07:300
153989988,0cyclictest329-21hwrng21:52:450
153989988,0cyclictest329-21hwrng00:09:590
153989987,1cyclictest702-21snmpd22:19:190
153989987,1cyclictest702-21snmpd19:31:490
154129977,0cyclictest702-21snmpd23:26:313
154129977,0cyclictest702-21snmpd23:15:123
154129977,0cyclictest702-21snmpd22:00:513
154129977,0cyclictest702-21snmpd21:35:143
154129977,0cyclictest702-21snmpd21:15:403
154129977,0cyclictest702-21snmpd21:06:283
154129977,0cyclictest702-21snmpd20:44:083
154129977,0cyclictest702-21snmpd20:17:053
154129977,0cyclictest702-21snmpd20:10:243
154129977,0cyclictest702-21snmpd19:58:573
154129977,0cyclictest702-21snmpd19:48:523
154129977,0cyclictest702-21snmpd19:41:463
154129977,0cyclictest702-21snmpd19:11:513
154129977,0cyclictest702-21snmpd00:00:533
154129977,0cyclictest329-21hwrng21:32:163
154129976,1cyclictest702-21snmpd22:13:103
154129976,1cyclictest702-21snmpd21:11:563
154129976,1cyclictest702-21snmpd20:32:363
154129976,1cyclictest702-21snmpd00:25:153
154129976,1cyclictest4415-21cat23:55:153
154129976,1cyclictest15310-21cat20:25:163
154129975,2cyclictest702-21snmpd22:42:503
154129975,2cyclictest702-21snmpd20:23:303
154129975,2cyclictest702-21snmpd19:33:523
154089977,0cyclictest702-21snmpd19:16:242
154039977,0cyclictest702-21snmpd22:33:111
154039977,0cyclictest702-21snmpd22:25:341
154039977,0cyclictest702-21snmpd19:52:131
154039977,0cyclictest702-21snmpd00:03:561
154039977,0cyclictest329-21hwrng23:35:091
154039977,0cyclictest329-21hwrng23:21:501
154039977,0cyclictest329-21hwrng22:50:051
154039977,0cyclictest329-21hwrng22:42:561
154039977,0cyclictest329-21hwrng22:11:121
154039977,0cyclictest329-21hwrng21:31:151
154039977,0cyclictest329-21hwrng21:10:471
154039977,0cyclictest329-21hwrng20:55:251
154039977,0cyclictest329-21hwrng20:06:151
154039977,0cyclictest329-21hwrng19:33:291
154039977,0cyclictest329-21hwrng19:28:231
154039977,0cyclictest329-21hwrng00:30:281
154039977,0cyclictest329-21hwrng00:29:251
154039977,0cyclictest329-21hwrng00:17:091
154039976,1cyclictest702-21snmpd23:25:461
154039975,2cyclictest702-21snmpd22:16:401
153989977,0cyclictest329-21hwrng23:02:240
153989977,0cyclictest329-21hwrng22:40:530
153989977,0cyclictest329-21hwrng22:00:570
153989977,0cyclictest329-21hwrng21:55:500
153989977,0cyclictest329-21hwrng20:25:440
153989977,0cyclictest329-21hwrng20:22:380
153989977,0cyclictest329-21hwrng19:26:200
153989977,0cyclictest329-21hwrng19:23:150
153989977,0cyclictest329-21hwrng19:15:030
153989977,0cyclictest329-21hwrng00:25:190
153989977,0cyclictest329-21hwrng00:20:130
153989977,0cyclictest329-21hwrng00:16:070
153989977,0cyclictest329-21hwrng00:14:030
153989976,1cyclictest702-21snmpd23:35:010
153989976,1cyclictest702-21snmpd23:30:550
153989976,1cyclictest702-21snmpd20:50:370
154129966,0cyclictest702-21snmpd23:43:463
154129966,0cyclictest702-21snmpd19:51:053
154129965,1cyclictest702-21snmpd21:41:303
154129964,2cyclictest702-21snmpd23:31:103
154089966,0cyclictest329-21hwrng23:17:452
154039966,0cyclictest702-21snmpd23:52:301
154039966,0cyclictest329-21hwrng23:18:471
154039966,0cyclictest329-21hwrng22:55:141
154039966,0cyclictest329-21hwrng22:46:011
154039966,0cyclictest329-21hwrng22:35:451
154039966,0cyclictest329-21hwrng21:05:391
154039966,0cyclictest329-21hwrng20:22:381
154039966,0cyclictest329-21hwrng20:15:281
154039966,0cyclictest329-21hwrng19:45:461
153989966,0cyclictest702-21snmpd23:56:310
153989966,0cyclictest702-21snmpd21:24:290
153989966,0cyclictest702-21snmpd21:19:260
153989966,0cyclictest702-21snmpd20:56:020
153989966,0cyclictest329-21hwrng23:13:390
153989966,0cyclictest329-21hwrng22:26:320
153989966,0cyclictest329-21hwrng21:11:480
153989966,0cyclictest329-21hwrng20:19:340
153989966,0cyclictest329-21hwrng20:13:260
153989966,0cyclictest329-21hwrng20:09:200
153989966,0cyclictest329-21hwrng19:14:030
153989965,1cyclictest702-21snmpd20:46:280
153989962,4cyclictest259-20systemd-journal21:25:260
154129955,0cyclictest702-21snmpd22:50:193
154129955,0cyclictest702-21snmpd19:27:253
154129955,0cyclictest329-21hwrng23:03:253
154129954,1cyclictest702-21snmpd23:49:313
154129954,1cyclictest702-21snmpd22:56:543
154129954,1cyclictest702-21snmpd20:07:123
154129954,1cyclictest702-21snmpd00:31:423
154129954,1cyclictest17025-21unixbench_multi23:05:243
154129953,2cyclictest14613-21cat00:20:143
154089954,1cyclictest60250irq/125-lan23:30:172
153989955,0cyclictest702-21snmpd23:46:130
153989955,0cyclictest702-21snmpd22:12:150
153989955,0cyclictest702-21snmpd21:03:230
153989955,0cyclictest702-21snmpd00:01:320
153989955,0cyclictest329-21hwrng23:50:310
153989955,0cyclictest329-21hwrng22:59:180
153989955,0cyclictest329-21hwrng22:36:470
153989955,0cyclictest329-21hwrng22:22:270
153989954,1cyclictest702-21snmpd23:17:390
154129944,0cyclictest702-21snmpd22:47:313
154129944,0cyclictest702-21snmpd22:35:553
154129944,0cyclictest702-21snmpd22:29:503
154129944,0cyclictest702-21snmpd22:06:153
154129944,0cyclictest329-21hwrng23:52:333
154129944,0cyclictest329-21hwrng21:45:353
154129944,0cyclictest329-21hwrng20:59:313
154129944,0cyclictest329-21hwrng20:45:103
154129944,0cyclictest329-21hwrng00:39:393
154129943,1cyclictest702-21snmpd22:33:253
154129943,1cyclictest27667-21kworker/3:0+events_freezable_power_21:58:353
154129943,1cyclictest27667-21kworker/3:0+events_freezable_power_20:52:413
154129943,1cyclictest27667-21kworker/3:0+events_freezable_power_19:35:483
154129943,1cyclictest18040-21ntpq21:50:173
154129942,2cyclictest702-21snmpd21:27:423
154129942,2cyclictest19464-21memory20:35:173
154129940,2cyclictest0-21swapper/300:05:123
154039943,1cyclictest15477-21df21:45:131
154039942,2cyclictest702-21snmpd19:10:191
154039940,1cyclictest0-21swapper/121:15:161
153989944,0cyclictest702-21snmpd23:29:240
153989944,0cyclictest702-21snmpd20:31:540
153989944,0cyclictest702-21snmpd19:51:490
153989943,1cyclictest702-21snmpd22:05:510
153989943,1cyclictest702-21snmpd19:46:010
153989943,1cyclictest22898-21grep23:20:170
154129933,0cyclictest329-21hwrng23:12:383
154129933,0cyclictest329-21hwrng22:21:253
154129932,1cyclictest702-21snmpd21:20:073
154129932,1cyclictest431ktimers/320:00:173
154129932,1cyclictest22658-21cat23:20:153
154129931,2cyclictest11366-21sed00:10:213
154129930,3cyclictest0-21swapper/319:17:003
154129930,2cyclictest20484-21ntpq19:20:173
154129930,2cyclictest12138-21apt-get00:15:123
154039932,1cyclictest5144-21/usr/sbin/munin21:20:141
154039932,1cyclictest32686-21grep23:45:141
154039932,1cyclictest17792-21kernelversion21:50:161
154039931,2cyclictest29849-21hddtemp_smartct22:20:141
153989933,0cyclictest702-21snmpd00:35:060
153989933,0cyclictest329-21hwrng23:44:220
153989932,1cyclictest4728-21cat20:00:150
153989931,2cyclictest9012-21cut22:50:000
153989931,2cyclictest25859-21sh19:35:130
153989931,2cyclictest20646-21sh20:40:000
153989931,2cyclictest1860-21awk22:30:160
153989930,2cyclictest28881-21ntpq19:40:190
153989920,1cyclictest9104-21munin-node22:50:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional