You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-28 - 08:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot7.osadl.org (updated Tue Oct 28, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7592991918,1cyclictest60250irq/125-lan22:30:162
7592991918,1cyclictest60250irq/125-lan21:57:292
7592991918,1cyclictest60250irq/125-lan19:32:192
7592991918,1cyclictest60250irq/125-lan19:10:142
7592991817,1cyclictest60250irq/125-lan23:50:222
7592991817,1cyclictest60250irq/125-lan21:45:132
7592991817,1cyclictest60250irq/125-lan21:15:182
7592991817,1cyclictest60250irq/125-lan20:20:122
7592991817,1cyclictest60250irq/125-lan19:45:182
7592991817,1cyclictest60250irq/125-lan00:35:232
7592991717,0cyclictest60250irq/125-lan22:40:222
7592991717,0cyclictest60250irq/125-lan20:02:452
7592991716,1cyclictest60250irq/125-lan21:10:132
7592991716,1cyclictest60250irq/125-lan20:40:182
7592991716,1cyclictest60250irq/125-lan20:05:132
7589991717,0cyclictest702-21snmpd23:20:231
7589991717,0cyclictest702-21snmpd20:47:501
7589991717,0cyclictest702-21snmpd20:37:311
7589991717,0cyclictest702-21snmpd19:21:351
7589991717,0cyclictest31733-21cat21:25:141
7592991616,0cyclictest60250irq/125-lan23:23:312
7592991616,0cyclictest60250irq/125-lan23:17:332
7592991616,0cyclictest60250irq/125-lan19:35:192
7592991615,1cyclictest60250irq/125-lan23:42:282
7592991615,1cyclictest60250irq/125-lan22:50:142
7592991615,1cyclictest60250irq/125-lan20:50:142
7592991615,1cyclictest60250irq/125-lan00:15:122
7592991615,1cyclictest60250irq/125-lan00:10:222
7592991515,0cyclictest60250irq/125-lan22:59:462
7592991515,0cyclictest60250irq/125-lan22:45:162
7592991515,0cyclictest60250irq/125-lan22:45:152
7592991515,0cyclictest60250irq/125-lan20:55:172
7592991515,0cyclictest60250irq/125-lan00:00:282
7592991514,1cyclictest60250irq/125-lan23:30:212
7592991514,1cyclictest60250irq/125-lan23:25:222
7592991514,1cyclictest60250irq/125-lan23:10:152
7592991514,1cyclictest60250irq/125-lan22:15:212
7592991514,1cyclictest60250irq/125-lan22:00:182
7592991514,1cyclictest60250irq/125-lan21:25:152
7592991514,1cyclictest60250irq/125-lan19:25:152
7592991514,1cyclictest60250irq/125-lan00:30:182
7597991414,0cyclictest329-21hwrng19:55:023
7592991414,0cyclictest60250irq/125-lan21:05:112
7592991413,1cyclictest60250irq/125-lan20:45:162
7592991413,1cyclictest60250irq/125-lan19:55:172
7592991413,1cyclictest60250irq/125-lan00:20:142
7592991413,1cyclictest60250irq/125-lan00:05:152
7589991414,0cyclictest702-21snmpd20:13:381
7589991414,0cyclictest329-21hwrng22:10:131
7589991414,0cyclictest329-21hwrng20:24:441
7589991414,0cyclictest329-21hwrng00:01:501
7592991313,0cyclictest60250irq/125-lan21:50:142
7592991313,0cyclictest60250irq/125-lan00:27:422
7592991312,1cyclictest60250irq/125-lan23:55:182
7592991312,1cyclictest60250irq/125-lan23:45:132
7592991312,1cyclictest60250irq/125-lan22:28:292
7592991312,1cyclictest60250irq/125-lan21:35:172
7592991312,1cyclictest60250irq/125-lan20:10:132
7592991312,1cyclictest60250irq/125-lan19:40:132
7592991312,1cyclictest60250irq/125-lan19:15:222
7589991313,0cyclictest329-21hwrng23:51:351
7589991313,0cyclictest329-21hwrng23:45:261
7589991313,0cyclictest329-21hwrng23:42:231
7589991313,0cyclictest329-21hwrng23:26:001
7589991313,0cyclictest329-21hwrng21:02:371
7589991313,0cyclictest329-21hwrng20:32:561
7589991313,0cyclictest329-21hwrng20:29:521
7589991313,0cyclictest329-21hwrng20:16:331
7589991313,0cyclictest329-21hwrng20:05:171
7589991313,0cyclictest329-21hwrng20:03:141
7589991313,0cyclictest329-21hwrng19:59:091
7589991313,0cyclictest329-21hwrng19:35:351
7589991313,0cyclictest329-21hwrng19:33:321
7589991313,0cyclictest329-21hwrng19:28:261
7582991313,0cyclictest329-21hwrng21:45:390
7592991212,0cyclictest60250irq/125-lan19:52:162
7592991211,1cyclictest60250irq/125-lan21:20:122
7592991211,1cyclictest60250irq/125-lan21:00:162
7592991211,1cyclictest60250irq/125-lan20:30:142
7592991211,1cyclictest60250irq/125-lan19:20:142
7589991212,0cyclictest329-21hwrng23:57:451
7589991212,0cyclictest329-21hwrng23:36:131
7589991212,0cyclictest329-21hwrng23:30:051
7589991212,0cyclictest329-21hwrng22:20:271
7589991212,0cyclictest329-21hwrng22:15:211
7589991212,0cyclictest329-21hwrng21:46:401
7589991212,0cyclictest329-21hwrng21:13:541
7589991212,0cyclictest329-21hwrng20:57:311
7589991212,0cyclictest329-21hwrng20:43:111
7589991212,0cyclictest329-21hwrng19:43:481
7589991212,0cyclictest329-21hwrng00:10:021
7589991212,0cyclictest329-21hwrng00:06:561
7592991111,0cyclictest60250irq/125-lan20:25:132
7592991110,1cyclictest60250irq/125-lan23:05:142
7592991110,1cyclictest60250irq/125-lan22:20:182
7592991110,1cyclictest60250irq/125-lan22:10:202
7589991111,0cyclictest329-21hwrng21:42:351
7589991111,0cyclictest329-21hwrng21:15:561
7589991111,0cyclictest329-21hwrng20:51:221
7589991111,0cyclictest329-21hwrng00:35:371
7589991111,0cyclictest329-21hwrng00:33:351
7589991111,0cyclictest329-21hwrng00:18:131
758299110,6cyclictest7651-21grep23:05:120
758299110,6cyclictest30944-21sed22:40:220
7592991010,0cyclictest60250irq/125-lan20:35:162
7589991010,0cyclictest329-21hwrng19:50:571
758299108,2cyclictest702-21snmpd00:27:440
758299106,4cyclictest4232-21cat00:15:150
758299100,7cyclictest21444-21sed23:39:590
758299100,5cyclictest31434-21cron22:45:000
758299100,5cyclictest31434-21cron22:44:590
75979996,2cyclictest702-21snmpd20:31:073
75929999,0cyclictest60250irq/125-lan23:35:162
75929999,0cyclictest60250irq/125-lan20:15:182
75829998,1cyclictest329-21hwrng19:29:280
75829997,2cyclictest702-21snmpd22:53:340
75829997,2cyclictest702-21snmpd21:31:340
75829997,2cyclictest702-21snmpd19:50:360
75829997,2cyclictest702-21snmpd19:36:140
75829997,2cyclictest702-21snmpd00:22:550
75829996,3cyclictest702-21snmpd21:51:250
75829996,3cyclictest702-21snmpd20:55:180
75829991,4cyclictest18588-21basename22:10:210
75829990,5cyclictest22358-21chrt21:03:150
75829990,5cyclictest22207-21sed23:40:160
75829990,4cyclictest8683-21taskset19:10:190
75979988,0cyclictest702-21snmpd22:56:533
75979988,0cyclictest702-21snmpd22:14:543
75979988,0cyclictest702-21snmpd21:50:253
75979988,0cyclictest702-21snmpd20:52:573
75979988,0cyclictest702-21snmpd00:11:503
75979988,0cyclictest702-21snmpd00:01:403
75979988,0cyclictest329-21hwrng23:20:533
75979988,0cyclictest329-21hwrng21:37:263
75979988,0cyclictest329-21hwrng21:25:103
75979988,0cyclictest329-21hwrng21:20:023
75929987,1cyclictest60250irq/125-lan23:00:172
75929987,1cyclictest60250irq/125-lan22:05:192
75899988,0cyclictest702-21snmpd23:10:091
75899988,0cyclictest702-21snmpd22:53:371
75899988,0cyclictest702-21snmpd22:29:041
75899987,1cyclictest702-21snmpd22:59:111
75829988,0cyclictest702-21snmpd22:32:400
75829986,2cyclictest702-21snmpd23:46:430
75829986,2cyclictest702-21snmpd21:57:500
75829985,3cyclictest702-21snmpd23:52:210
75829980,6cyclictest31329-21wc00:00:230
75829980,6cyclictest15008-21taskset23:21:470
75829980,5cyclictest5173-21fschecks_count21:40:140
75829980,5cyclictest3838-21turbostat.cron20:24:550
75829980,5cyclictest21722-21cut19:45:010
75829980,5cyclictest13251-21sed20:40:180
75829980,4cyclictest28274-21sed22:35:150
75829980,4cyclictest12696-21ld00:35:190
75829980,3cyclictest22676-21ntpq19:45:160
75979977,0cyclictest702-21snmpd23:18:563
75979977,0cyclictest702-21snmpd23:00:463
75979977,0cyclictest702-21snmpd20:21:383
75979977,0cyclictest329-21hwrng23:56:433
75979977,0cyclictest329-21hwrng22:08:103
75979977,0cyclictest329-21hwrng21:17:593
75979977,0cyclictest329-21hwrng21:10:503
75979977,0cyclictest329-21hwrng21:06:443
75979977,0cyclictest329-21hwrng20:56:303
75979977,0cyclictest329-21hwrng20:46:143
75979977,0cyclictest329-21hwrng19:19:123
75979977,0cyclictest329-21hwrng00:20:163
75979977,0cyclictest329-21hwrng00:19:143
75979976,1cyclictest702-21snmpd22:52:353
75979976,1cyclictest702-21snmpd21:56:113
75979976,1cyclictest702-21snmpd20:16:013
75979976,1cyclictest702-21snmpd20:08:133
75979976,1cyclictest702-21snmpd19:25:323
75929976,1cyclictest60250irq/125-lan22:39:592
75929976,1cyclictest60250irq/125-lan21:40:222
75929976,1cyclictest60250irq/125-lan21:30:172
75899977,0cyclictest702-21snmpd22:43:071
75899977,0cyclictest702-21snmpd00:28:381
75899976,1cyclictest702-21snmpd21:23:361
75829977,0cyclictest329-21hwrng20:03:140
75829976,1cyclictest702-21snmpd20:25:320
75829975,2cyclictest702-21snmpd22:26:450
75829975,2cyclictest702-21snmpd20:38:490
75829972,4cyclictest15995-21cat23:25:150
75829971,5cyclictest1756-21apt00:10:130
75829970,6cyclictest30840-21expr20:05:140
75829970,6cyclictest27924-21cat20:00:010
75829970,6cyclictest23627-21ntpq21:05:170
75829970,6cyclictest19581-21dpkg22:15:130
75829970,6cyclictest13954-21/usr/sbin/munin22:00:160
75829970,4cyclictest6140-21ntpq23:00:190
75829970,4cyclictest30067-21ntpq21:20:160
75829970,4cyclictest16987-21sed19:30:210
75829970,4cyclictest12604-21ntpq19:20:180
75829970,4cyclictest0-21swapper/021:35:150
75829970,4cyclictest0-21swapper/021:15:150
75829970,3cyclictest10296-21ntp_states23:10:170
75979966,0cyclictest702-21snmpd23:54:343
75979966,0cyclictest702-21snmpd23:38:553
75979966,0cyclictest702-21snmpd23:12:093
75979966,0cyclictest702-21snmpd22:19:063
75979966,0cyclictest702-21snmpd00:31:563
75979966,0cyclictest702-21snmpd00:08:293
75979965,1cyclictest702-21snmpd23:42:103
75979965,1cyclictest702-21snmpd22:31:013
75979965,1cyclictest702-21snmpd21:45:553
75979965,1cyclictest702-21snmpd20:44:273
75979965,1cyclictest702-21snmpd19:46:483
75899966,0cyclictest702-21snmpd21:38:061
75899965,1cyclictest702-21snmpd21:31:581
75899965,1cyclictest702-21snmpd19:48:151
75829966,0cyclictest700-21lldpd19:17:300
75829965,1cyclictest329-21hwrng22:20:270
75829962,4cyclictest9072-21cat20:30:130
75829962,4cyclictest25023-21tune2fs21:10:140
75829960,6cyclictest4117-21ntpq22:55:170
75829960,6cyclictest14890-21diskstats20:45:120
75829960,6cyclictest1371-21unixbench_singl20:10:210
75829960,5cyclictest32186-21/usr/sbin/munin00:05:100
75829960,5cyclictest29955-21ls00:00:000
75829960,5cyclictest17565-21grep23:30:130
75829960,5cyclictest15624-21grep22:05:120
75829960,5cyclictest12849-21users23:15:260
75829960,5cyclictest10620-21ntpq00:30:180
75829960,3cyclictest0-21swapper/020:50:290
75829960,3cyclictest0-21swapper/020:17:010
75979955,0cyclictest702-21snmpd21:32:513
75979955,0cyclictest702-21snmpd19:35:243
75979955,0cyclictest329-21hwrng19:20:153
75979954,1cyclictest702-21snmpd23:07:243
75979954,1cyclictest702-21snmpd22:46:323
75979954,1cyclictest702-21snmpd22:46:313
75979954,1cyclictest702-21snmpd22:20:093
75979954,1cyclictest16268-21gltestperf19:30:143
75979953,2cyclictest21615-21ntpq21:00:193
75979950,5cyclictest27421-21turbostat22:39:543
75899954,1cyclictest702-21snmpd22:46:591
75899954,1cyclictest702-21snmpd22:46:581
75899954,1cyclictest702-21snmpd22:08:321
75899952,1cyclictest171rcu_preempt21:54:591
75829950,5cyclictest31422-21cpuspeed_turbos21:25:120
75979944,0cyclictest329-21hwrng19:14:053
75979944,0cyclictest329-21hwrng00:29:293
75979943,1cyclictest702-21snmpd23:31:243
75979943,1cyclictest702-21snmpd22:25:463
75979943,1cyclictest702-21snmpd00:39:153
75979943,1cyclictest431ktimers/321:40:173
75979942,2cyclictest702-21snmpd20:35:443
75979942,2cyclictest702-21snmpd20:00:333
75979942,2cyclictest20566-21sed19:40:153
75979942,2cyclictest14387-21ntpq22:00:183
75899943,1cyclictest702-21snmpd23:16:231
75899943,1cyclictest702-21snmpd22:02:441
75899943,1cyclictest702-21snmpd19:12:081
75899943,1cyclictest5833-21cat23:00:161
75899942,0cyclictest28-21ksoftirqd/121:55:151
75899940,2cyclictest7615-21grep23:05:121
75979933,0cyclictest702-21snmpd23:45:453
75979933,0cyclictest0-21swapper/320:10:123
75979931,2cyclictest702-21snmpd20:29:233
75979931,2cyclictest29991-21perl22:40:143
75979931,2cyclictest25130-21grep19:50:233
75979930,3cyclictest15295-21turbostat23:29:553
75899932,1cyclictest0-21swapper/100:20:161
75899930,1cyclictest27893-21cut22:35:131
75899930,1cyclictest171rcu_preempt22:30:161
75899930,1cyclictest171rcu_preempt21:05:111
75899930,1cyclictest0-21swapper/119:15:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional