You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-17 - 10:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Fri Oct 17, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28169991818,0cyclictest60250irq/125-lan22:50:022
28169991818,0cyclictest60250irq/125-lan21:48:172
28169991817,1cyclictest60250irq/125-lan19:35:162
28169991817,1cyclictest60250irq/125-lan00:05:212
28169991717,0cyclictest60250irq/125-lan23:00:182
28169991716,1cyclictest60250irq/125-lan23:40:222
28169991716,1cyclictest60250irq/125-lan23:20:182
28169991716,1cyclictest60250irq/125-lan20:50:192
28169991716,1cyclictest60250irq/125-lan00:35:172
28169991716,1cyclictest60250irq/125-lan00:10:222
28169991616,0cyclictest60250irq/125-lan23:48:062
28169991616,0cyclictest60250irq/125-lan23:25:202
28169991616,0cyclictest60250irq/125-lan23:10:122
28169991616,0cyclictest60250irq/125-lan20:40:212
28169991616,0cyclictest60250irq/125-lan19:32:282
28169991615,1cyclictest60250irq/125-lan23:55:172
28169991615,1cyclictest60250irq/125-lan23:35:152
28169991615,1cyclictest60250irq/125-lan23:15:002
28169991615,1cyclictest60250irq/125-lan21:35:182
28169991615,1cyclictest60250irq/125-lan21:05:202
28169991615,1cyclictest60250irq/125-lan20:36:272
28169991615,1cyclictest60250irq/125-lan20:10:152
28169991615,1cyclictest60250irq/125-lan19:50:152
28162991616,0cyclictest329-21hwrng21:19:230
28162991616,0cyclictest24519-21cat21:50:100
28169991515,0cyclictest60250irq/125-lan22:41:382
28169991515,0cyclictest60250irq/125-lan22:30:222
28169991515,0cyclictest60250irq/125-lan21:28:152
28169991515,0cyclictest60250irq/125-lan20:57:462
28169991514,1cyclictest60250irq/125-lan22:35:162
28169991514,1cyclictest60250irq/125-lan22:10:212
28169991514,1cyclictest60250irq/125-lan21:40:202
28169991514,1cyclictest60250irq/125-lan20:30:122
28169991514,1cyclictest60250irq/125-lan19:45:242
28162991515,0cyclictest329-21hwrng19:48:150
28169991414,0cyclictest60250irq/125-lan21:55:012
28169991414,0cyclictest60250irq/125-lan21:02:342
28169991414,0cyclictest60250irq/125-lan20:00:212
28169991413,1cyclictest60250irq/125-lan23:53:362
28169991413,1cyclictest60250irq/125-lan21:55:172
28169991413,1cyclictest60250irq/125-lan21:18:022
28169991413,1cyclictest60250irq/125-lan20:15:092
28169991413,1cyclictest60250irq/125-lan19:25:182
28169991413,1cyclictest60250irq/125-lan19:10:222
28162991414,0cyclictest329-21hwrng20:42:300
28162991414,0cyclictest329-21hwrng19:44:080
28169991313,0cyclictest60250irq/125-lan22:48:252
28169991313,0cyclictest60250irq/125-lan22:04:392
28169991313,0cyclictest60250irq/125-lan20:25:172
28169991313,0cyclictest60250irq/125-lan19:55:162
28169991313,0cyclictest60250irq/125-lan00:00:122
28169991312,1cyclictest60250irq/125-lan23:05:242
28169991312,1cyclictest60250irq/125-lan22:20:172
28169991312,1cyclictest60250irq/125-lan22:05:392
28169991312,1cyclictest60250irq/125-lan21:30:012
28169991312,1cyclictest60250irq/125-lan20:45:132
28169991312,1cyclictest60250irq/125-lan19:20:082
28169991312,1cyclictest60250irq/125-lan00:20:272
28169991311,2cyclictest60250irq/125-lan21:10:102
28167991313,0cyclictest329-21hwrng23:42:441
28162991313,0cyclictest329-21hwrng23:43:460
28162991313,0cyclictest329-21hwrng19:23:390
28162991313,0cyclictest329-21hwrng00:36:590
28169991211,1cyclictest60250irq/125-lan23:30:002
28169991211,1cyclictest60250irq/125-lan20:20:122
28169991211,1cyclictest60250irq/125-lan00:30:212
28162991212,0cyclictest329-21hwrng23:45:470
28162991212,0cyclictest329-21hwrng22:58:420
28162991212,0cyclictest329-21hwrng22:00:190
28169991111,0cyclictest60250irq/125-lan20:05:142
28169991110,1cyclictest60250irq/125-lan22:55:172
28169991110,1cyclictest60250irq/125-lan22:15:162
2816999109,1cyclictest60250irq/125-lan00:15:172
28169991010,0cyclictest60250irq/125-lan21:23:022
28169991010,0cyclictest60250irq/125-lan19:15:332
28162991010,0cyclictest329-21hwrng20:14:510
28162991010,0cyclictest329-21hwrng00:05:150
281739999,0cyclictest329-21hwrng19:43:073
281679998,1cyclictest702-21snmpd21:45:251
281629999,0cyclictest329-21hwrng23:37:370
281629999,0cyclictest329-21hwrng23:00:440
281629999,0cyclictest329-21hwrng22:51:320
281629999,0cyclictest329-21hwrng22:41:180
281629999,0cyclictest329-21hwrng22:26:580
281629999,0cyclictest329-21hwrng21:55:120
281629999,0cyclictest329-21hwrng21:39:510
281629999,0cyclictest329-21hwrng21:30:370
281629999,0cyclictest329-21hwrng19:33:540
281629999,0cyclictest329-21hwrng19:16:300
281739988,0cyclictest702-21snmpd23:46:483
281739988,0cyclictest702-21snmpd22:19:273
281739988,0cyclictest702-21snmpd20:52:143
281739988,0cyclictest329-21hwrng23:18:093
281739988,0cyclictest329-21hwrng23:04:503
281739988,0cyclictest329-21hwrng22:04:263
281739988,0cyclictest329-21hwrng21:34:443
281739988,0cyclictest329-21hwrng21:19:233
281739988,0cyclictest329-21hwrng19:37:593
281739988,0cyclictest329-21hwrng00:34:563
281739988,0cyclictest329-21hwrng00:11:243
281739988,0cyclictest329-21hwrng00:01:093
281739986,2cyclictest702-21snmpd20:38:043
281699987,1cyclictest60250irq/125-lan19:40:162
281699987,1cyclictest60250irq/125-lan00:25:192
281679988,0cyclictest702-21snmpd23:57:111
281679988,0cyclictest702-21snmpd23:11:511
281679988,0cyclictest702-21snmpd22:53:091
281679988,0cyclictest702-21snmpd22:07:141
281679988,0cyclictest702-21snmpd21:56:221
281679988,0cyclictest702-21snmpd19:46:541
281679988,0cyclictest702-21snmpd19:10:111
281679986,1cyclictest702-21snmpd23:01:411
281629988,0cyclictest702-21snmpd23:09:120
281629988,0cyclictest702-21snmpd20:37:550
281629988,0cyclictest329-21hwrng23:50:550
281629988,0cyclictest329-21hwrng22:47:250
281629988,0cyclictest329-21hwrng21:26:320
281629988,0cyclictest329-21hwrng21:21:250
281629988,0cyclictest329-21hwrng20:16:550
281629988,0cyclictest329-21hwrng00:33:560
281629988,0cyclictest329-21hwrng00:11:240
281629986,2cyclictest702-21snmpd22:20:060
281739977,0cyclictest702-21snmpd23:56:113
281739977,0cyclictest702-21snmpd21:10:323
281739977,0cyclictest702-21snmpd20:29:083
281739977,0cyclictest702-21snmpd19:48:083
281739977,0cyclictest329-21hwrng23:32:293
281739977,0cyclictest329-21hwrng23:29:243
281739977,0cyclictest329-21hwrng22:39:153
281739977,0cyclictest329-21hwrng22:34:083
281739977,0cyclictest329-21hwrng22:12:363
281739977,0cyclictest329-21hwrng22:05:273
281739977,0cyclictest329-21hwrng21:36:463
281739977,0cyclictest329-21hwrng21:26:323
281739977,0cyclictest329-21hwrng21:04:013
281739977,0cyclictest329-21hwrng20:32:163
281739977,0cyclictest329-21hwrng19:52:193
281739977,0cyclictest329-21hwrng19:34:553
281739977,0cyclictest329-21hwrng19:17:303
281739977,0cyclictest329-21hwrng19:12:243
281739977,0cyclictest329-21hwrng00:29:503
281739977,0cyclictest329-21hwrng00:20:373
281739977,0cyclictest329-21hwrng00:15:293
281739976,1cyclictest702-21snmpd21:21:003
281739976,1cyclictest702-21snmpd19:23:433
281739976,1cyclictest1902-21cat20:45:153
281679977,0cyclictest702-21snmpd23:51:461
281679977,0cyclictest702-21snmpd22:03:491
281679977,0cyclictest702-21snmpd21:41:271
281679977,0cyclictest702-21snmpd21:32:041
281679977,0cyclictest702-21snmpd20:22:581
281679977,0cyclictest702-21snmpd20:06:001
281679977,0cyclictest702-21snmpd19:29:341
281679976,1cyclictest702-21snmpd22:24:331
281679976,1cyclictest702-21snmpd21:21:131
281679976,1cyclictest702-21snmpd20:57:471
281679976,1cyclictest702-21snmpd20:02:041
281679976,1cyclictest702-21snmpd00:34:081
281679976,1cyclictest702-21snmpd00:20:471
281679975,2cyclictest702-21snmpd19:54:561
281629977,0cyclictest702-21snmpd19:27:070
281629977,0cyclictest329-21hwrng23:29:250
281629977,0cyclictest329-21hwrng22:39:150
281629977,0cyclictest329-21hwrng22:30:010
281629977,0cyclictest329-21hwrng21:40:520
281629977,0cyclictest329-21hwrng19:35:560
281629977,0cyclictest329-21hwrng00:28:490
281629976,1cyclictest702-21snmpd20:00:250
281629971,1cyclictest9328-21dump-pmu-power21:05:010
281739966,0cyclictest702-21snmpd22:48:123
281739966,0cyclictest702-21snmpd21:48:053
281739966,0cyclictest702-21snmpd21:43:303
281739966,0cyclictest329-21hwrng23:42:433
281739966,0cyclictest329-21hwrng23:13:013
281739966,0cyclictest329-21hwrng23:05:523
281739966,0cyclictest329-21hwrng22:23:533
281739966,0cyclictest329-21hwrng19:25:433
281739966,0cyclictest329-21hwrng00:35:593
281739965,1cyclictest702-21snmpd23:50:193
281739965,1cyclictest702-21snmpd20:24:373
281739965,1cyclictest702-21snmpd20:19:073
281679966,0cyclictest702-21snmpd22:28:261
281679966,0cyclictest702-21snmpd21:36:161
281679966,0cyclictest702-21snmpd00:16:251
281679966,0cyclictest702-21snmpd00:06:021
281679966,0cyclictest329-21hwrng21:10:091
281679965,1cyclictest702-21snmpd23:07:151
281679965,1cyclictest702-21snmpd20:12:571
281679965,1cyclictest702-21snmpd19:30:411
281679965,1cyclictest702-21snmpd19:18:561
281679965,1cyclictest24416-21sed21:50:091
281679964,2cyclictest702-21snmpd21:25:061
281629966,0cyclictest702-21snmpd21:46:250
281629966,0cyclictest702-21snmpd19:53:590
281629965,1cyclictest702-21snmpd23:34:030
281629965,1cyclictest702-21snmpd23:20:580
281629965,1cyclictest702-21snmpd21:06:060
281739955,0cyclictest702-21snmpd22:40:493
281739955,0cyclictest329-21hwrng22:52:343
281739955,0cyclictest329-21hwrng22:26:573
281739954,1cyclictest702-21snmpd21:53:083
281739954,1cyclictest702-21snmpd00:08:503
281699954,1cyclictest60250irq/125-lan22:28:372
281679955,0cyclictest702-21snmpd19:44:291
281679955,0cyclictest329-21hwrng21:01:581
281679955,0cyclictest31114-21cpuspeed_turbos23:25:141
281679954,1cyclictest702-21snmpd23:39:581
281679954,1cyclictest702-21snmpd23:31:571
281679954,1cyclictest702-21snmpd22:32:251
281679954,1cyclictest702-21snmpd22:14:171
281679954,1cyclictest702-21snmpd00:39:241
281629955,0cyclictest702-21snmpd22:18:560
281629955,0cyclictest702-21snmpd20:56:350
281629955,0cyclictest702-21snmpd20:07:480
281629954,1cyclictest702-21snmpd23:55:190
281629954,1cyclictest1200-21turbostat20:49:560
281739944,0cyclictest329-21hwrng21:06:033
281739944,0cyclictest329-21hwrng20:56:503
281739944,0cyclictest329-21hwrng20:09:443
281739943,1cyclictest702-21snmpd19:55:453
281739943,1cyclictest431ktimers/323:35:183
281739943,1cyclictest32237-21head20:40:173
281739940,3cyclictest15703-21apt-get20:00:103
281679944,0cyclictest329-21hwrng23:21:141
281679944,0cyclictest329-21hwrng22:45:221
281679944,0cyclictest329-21hwrng22:38:131
281679944,0cyclictest329-21hwrng22:15:411
281679944,0cyclictest329-21hwrng21:08:071
281679944,0cyclictest329-21hwrng20:41:281
281679944,0cyclictest329-21hwrng20:35:201
281679944,0cyclictest329-21hwrng19:57:261
281679944,0cyclictest329-21hwrng00:13:271
281679944,0cyclictest329-21hwrng00:00:081
281679943,1cyclictest702-21snmpd20:52:021
281679943,1cyclictest31818-21ntpq19:20:131
281679943,1cyclictest12725-21ntpq22:40:211
281679942,2cyclictest702-21snmpd20:49:241
281679942,2cyclictest702-21snmpd20:19:101
281679942,2cyclictest702-21snmpd00:25:201
281629944,0cyclictest702-21snmpd19:57:200
281629943,1cyclictest24636-21turbostat23:14:560
281629942,2cyclictest259-20systemd-journal00:00:030
281629940,1cyclictest28542-21ntpq20:30:140
281739933,0cyclictest329-21hwrng20:11:483
281739932,1cyclictest26095-21apt-get21:55:113
281739931,2cyclictest29258-21fw_forwarded_lo23:20:153
281679933,0cyclictest329-21hwrng20:30:141
281679933,0cyclictest329-21hwrng20:25:051
281679932,1cyclictest5476-21gltestperf19:35:141
281679931,2cyclictest702-21snmpd23:45:031
281679931,2cyclictest702-21snmpd23:15:171
281679931,2cyclictest15109-21sshd21:16:391
281629933,0cyclictest0-21swapper/020:25:160
281629932,1cyclictest702-21snmpd20:50:150
281629932,1cyclictest680-21ntpd22:05:200
281629931,2cyclictest702-21snmpd20:20:120
281629931,2cyclictest28525-21diskstats19:10:130
281629931,2cyclictest27544-21needreboot23:15:170
281629931,2cyclictest21149-21awk00:20:000
281629931,2cyclictest12079-21cat21:10:130
281629930,1cyclictest171rcu_preempt22:10:150
281629930,1cyclictest0-21swapper/000:18:470
281739920,2cyclictest18479-21dpkg22:55:003
281679920,2cyclictest18453-21cp22:55:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional