You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 10:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot7.osadl.org (updated Sun Nov 30, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13294991918,1cyclictest60250irq/125-lan23:23:412
13294991818,0cyclictest60250irq/125-lan23:12:352
13294991818,0cyclictest60250irq/125-lan23:12:352
13294991818,0cyclictest60250irq/125-lan22:49:312
13294991818,0cyclictest60250irq/125-lan21:51:162
13294991818,0cyclictest60250irq/125-lan19:35:182
13294991817,1cyclictest60250irq/125-lan20:25:002
13294991817,1cyclictest60250irq/125-lan20:10:182
13294991717,0cyclictest60250irq/125-lan22:38:182
13294991717,0cyclictest60250irq/125-lan19:28:212
13294991716,1cyclictest60250irq/125-lan21:45:132
13294991716,1cyclictest60250irq/125-lan20:55:162
13294991716,1cyclictest60250irq/125-lan19:15:252
13294991716,1cyclictest60250irq/125-lan00:35:182
13294991716,1cyclictest60250irq/125-lan00:30:172
13294991616,0cyclictest60250irq/125-lan23:05:192
13294991616,0cyclictest60250irq/125-lan23:02:302
13294991616,0cyclictest60250irq/125-lan21:25:132
13294991616,0cyclictest60250irq/125-lan00:25:242
13294991615,1cyclictest60250irq/125-lan22:55:142
13294991615,1cyclictest60250irq/125-lan22:30:212
13294991615,1cyclictest60250irq/125-lan19:52:402
13294991615,1cyclictest60250irq/125-lan19:30:162
13294991515,0cyclictest60250irq/125-lan22:40:312
13294991515,0cyclictest60250irq/125-lan21:18:302
13294991515,0cyclictest60250irq/125-lan20:53:052
13294991515,0cyclictest60250irq/125-lan20:35:222
13294991515,0cyclictest60250irq/125-lan20:30:182
13294991515,0cyclictest60250irq/125-lan19:47:272
13294991515,0cyclictest60250irq/125-lan19:40:192
13294991515,0cyclictest60250irq/125-lan19:20:222
13294991515,0cyclictest60250irq/125-lan00:05:192
13294991514,1cyclictest60250irq/125-lan23:40:242
13294991514,1cyclictest60250irq/125-lan22:20:152
13294991514,1cyclictest60250irq/125-lan22:00:152
13294991514,1cyclictest60250irq/125-lan21:55:152
13294991514,1cyclictest60250irq/125-lan21:00:152
13294991514,1cyclictest60250irq/125-lan20:45:022
13294991514,1cyclictest60250irq/125-lan20:05:192
13294991414,0cyclictest60250irq/125-lan23:56:312
13294991414,0cyclictest60250irq/125-lan21:40:002
13294991414,0cyclictest60250irq/125-lan21:35:212
13294991414,0cyclictest60250irq/125-lan21:10:192
13294991414,0cyclictest60250irq/125-lan20:40:152
13294991414,0cyclictest60250irq/125-lan20:01:572
13294991413,1cyclictest60250irq/125-lan21:20:152
13294991413,1cyclictest60250irq/125-lan20:25:002
13294991413,1cyclictest60250irq/125-lan20:15:182
13294991413,1cyclictest60250irq/125-lan00:00:142
13294991313,0cyclictest60250irq/125-lan22:05:192
13294991313,0cyclictest60250irq/125-lan19:55:132
13294991313,0cyclictest60250irq/125-lan00:10:202
13294991312,1cyclictest60250irq/125-lan23:50:142
13294991312,1cyclictest60250irq/125-lan23:15:122
13294991212,0cyclictest60250irq/125-lan23:35:212
13294991212,0cyclictest60250irq/125-lan23:26:112
13294991212,0cyclictest60250irq/125-lan22:50:172
13294991212,0cyclictest60250irq/125-lan21:07:112
13294991212,0cyclictest60250irq/125-lan19:10:142
13294991212,0cyclictest60250irq/125-lan00:20:132
13294991212,0cyclictest60250irq/125-lan00:15:192
13294991211,1cyclictest60250irq/125-lan22:10:162
13294991211,1cyclictest60250irq/125-lan21:30:172
13294991111,0cyclictest60250irq/125-lan22:25:142
13294991110,1cyclictest60250irq/125-lan23:30:112
13282991111,0cyclictest329-21hwrng22:18:220
13294991010,0cyclictest60250irq/125-lan22:15:202
13289991010,0cyclictest329-21hwrng19:25:181
132989998,1cyclictest702-21snmpd23:22:343
132899999,0cyclictest329-21hwrng00:15:061
132989988,0cyclictest702-21snmpd23:12:393
132989988,0cyclictest702-21snmpd23:12:393
132989988,0cyclictest702-21snmpd22:47:203
132989988,0cyclictest702-21snmpd21:04:073
132989988,0cyclictest702-21snmpd20:48:423
132989988,0cyclictest702-21snmpd00:18:053
132989986,2cyclictest702-21snmpd20:22:153
132899988,0cyclictest702-21snmpd23:02:121
132899988,0cyclictest702-21snmpd00:12:381
132899988,0cyclictest329-21hwrng23:41:181
132899988,0cyclictest329-21hwrng23:37:121
132899988,0cyclictest329-21hwrng22:48:031
132899988,0cyclictest329-21hwrng21:57:531
132899988,0cyclictest329-21hwrng21:51:441
132899988,0cyclictest329-21hwrng21:42:311
132899988,0cyclictest329-21hwrng21:38:251
132899988,0cyclictest329-21hwrng21:22:021
132899988,0cyclictest329-21hwrng21:18:571
132899988,0cyclictest329-21hwrng21:14:521
132899988,0cyclictest329-21hwrng21:05:391
132899988,0cyclictest329-21hwrng21:01:341
132899988,0cyclictest329-21hwrng20:36:591
132899988,0cyclictest329-21hwrng19:46:481
132899988,0cyclictest329-21hwrng19:32:271
132829988,0cyclictest702-21snmpd22:29:380
132829988,0cyclictest702-21snmpd21:07:370
132829988,0cyclictest329-21hwrng23:25:570
132829988,0cyclictest329-21hwrng22:01:590
132829988,0cyclictest329-21hwrng00:01:470
132989977,0cyclictest702-21snmpd23:56:173
132989977,0cyclictest702-21snmpd23:17:033
132989977,0cyclictest702-21snmpd22:30:553
132989977,0cyclictest702-21snmpd20:25:183
132989976,1cyclictest702-21snmpd23:01:063
132989976,1cyclictest702-21snmpd21:05:293
132989976,1cyclictest702-21snmpd00:30:423
132989976,1cyclictest702-21snmpd00:23:033
132989974,2cyclictest702-21snmpd22:40:023
132989974,2cyclictest702-21snmpd19:42:223
132949977,0cyclictest60250irq/125-lan23:45:182
132899977,0cyclictest702-21snmpd22:21:391
132899977,0cyclictest702-21snmpd22:17:311
132899977,0cyclictest329-21hwrng23:57:411
132899977,0cyclictest329-21hwrng23:32:041
132899977,0cyclictest329-21hwrng23:25:571
132899977,0cyclictest329-21hwrng23:20:491
132899977,0cyclictest329-21hwrng23:16:431
132899977,0cyclictest329-21hwrng23:11:361
132899977,0cyclictest329-21hwrng23:11:361
132899977,0cyclictest329-21hwrng23:07:301
132899977,0cyclictest329-21hwrng22:50:051
132899977,0cyclictest329-21hwrng22:41:551
132899977,0cyclictest329-21hwrng22:35:451
132899977,0cyclictest329-21hwrng22:31:401
132899977,0cyclictest329-21hwrng22:28:361
132899977,0cyclictest329-21hwrng22:10:101
132899977,0cyclictest329-21hwrng22:01:591
132899977,0cyclictest329-21hwrng21:46:371
132899977,0cyclictest329-21hwrng21:31:141
132899977,0cyclictest329-21hwrng21:28:111
132899977,0cyclictest329-21hwrng20:58:291
132899977,0cyclictest329-21hwrng20:46:111
132899977,0cyclictest329-21hwrng20:43:081
132899977,0cyclictest329-21hwrng20:20:361
132899977,0cyclictest329-21hwrng20:16:291
132899977,0cyclictest329-21hwrng20:10:221
132899977,0cyclictest329-21hwrng20:09:201
132899977,0cyclictest329-21hwrng20:00:061
132899977,0cyclictest329-21hwrng19:52:571
132899977,0cyclictest329-21hwrng19:20:111
132899977,0cyclictest329-21hwrng19:19:091
132899977,0cyclictest329-21hwrng00:25:201
132899977,0cyclictest329-21hwrng00:20:131
132899977,0cyclictest329-21hwrng00:09:581
132899977,0cyclictest329-21hwrng00:03:501
132899976,1cyclictest702-21snmpd20:27:571
132899976,1cyclictest29909-21cat23:45:151
132899975,2cyclictest702-21snmpd20:50:071
132829977,0cyclictest702-21snmpd22:38:460
132829977,0cyclictest702-21snmpd21:47:120
132829977,0cyclictest702-21snmpd19:30:570
132829976,1cyclictest702-21snmpd22:30:080
132829976,1cyclictest702-21snmpd21:13:260
132829976,1cyclictest702-21snmpd20:45:580
132829976,1cyclictest702-21snmpd19:27:280
132829976,1cyclictest702-21snmpd00:33:360
132829975,2cyclictest702-21snmpd00:10:560
132989966,0cyclictest702-21snmpd22:27:533
132989966,0cyclictest702-21snmpd22:07:523
132989966,0cyclictest702-21snmpd21:22:563
132989965,1cyclictest702-21snmpd23:48:403
132989965,1cyclictest702-21snmpd23:36:103
132989965,1cyclictest702-21snmpd23:28:403
132989965,1cyclictest702-21snmpd22:58:093
132989965,1cyclictest702-21snmpd22:10:163
132989965,1cyclictest702-21snmpd21:17:103
132989965,1cyclictest702-21snmpd19:37:293
132989965,1cyclictest702-21snmpd00:38:153
132989965,1cyclictest702-21snmpd00:00:293
132989965,1cyclictest6312-21cat21:30:133
132989965,1cyclictest18417-21cat20:40:173
132989965,1cyclictest16880-21cat21:55:153
132899966,0cyclictest329-21hwrng22:05:031
132899966,0cyclictest329-21hwrng19:57:031
132899966,0cyclictest329-21hwrng19:35:331
132899966,0cyclictest329-21hwrng19:10:571
132899965,1cyclictest702-21snmpd20:31:541
132899965,1cyclictest702-21snmpd00:39:151
132899965,1cyclictest702-21snmpd00:31:181
132829966,0cyclictest702-21snmpd22:46:260
132829966,0cyclictest702-21snmpd21:37:480
132829966,0cyclictest702-21snmpd19:22:520
132829966,0cyclictest329-21hwrng20:51:190
132829965,1cyclictest702-21snmpd23:24:130
132829965,1cyclictest702-21snmpd20:03:560
132829965,1cyclictest702-21snmpd19:58:530
132829965,1cyclictest702-21snmpd00:06:080
132989955,0cyclictest702-21snmpd23:07:123
132989955,0cyclictest702-21snmpd22:35:413
132989955,0cyclictest702-21snmpd19:56:073
132989955,0cyclictest702-21snmpd19:25:123
132989955,0cyclictest702-21snmpd19:16:463
132989955,0cyclictest329-21hwrng22:16:183
132989955,0cyclictest329-21hwrng20:54:243
132989954,1cyclictest702-21snmpd20:06:543
132989954,1cyclictest702-21snmpd00:07:413
132989954,1cyclictest30167-21cpuspeed_turbos19:50:133
132989954,1cyclictest15091-21cron00:30:003
132899955,0cyclictest329-21hwrng22:57:161
132829955,0cyclictest702-21snmpd23:56:320
132829955,0cyclictest702-21snmpd23:32:160
132829955,0cyclictest702-21snmpd22:41:080
132829955,0cyclictest702-21snmpd20:41:160
132829955,0cyclictest329-21hwrng22:55:130
132829955,0cyclictest329-21hwrng22:05:020
132829955,0cyclictest329-21hwrng19:14:030
132829954,1cyclictest702-21snmpd21:40:390
132829954,1cyclictest702-21snmpd00:17:320
132829954,1cyclictest4470-21needreboot21:25:160
132829953,2cyclictest4606-21ntp_states20:05:200
132829950,5cyclictest12600-21cut23:05:000
132989944,0cyclictest702-21snmpd19:48:593
132989944,0cyclictest329-21hwrng21:53:473
132989944,0cyclictest329-21hwrng21:35:213
132989944,0cyclictest329-21hwrng21:26:083
132989944,0cyclictest329-21hwrng20:55:253
132989944,0cyclictest329-21hwrng20:38:013
132989944,0cyclictest329-21hwrng00:14:043
132989944,0cyclictest19269-21turbostat19:25:003
132989943,1cyclictest702-21snmpd23:51:233
132989943,1cyclictest702-21snmpd22:52:443
132989943,1cyclictest702-21snmpd22:24:403
132989943,1cyclictest702-21snmpd21:12:383
132989943,1cyclictest431ktimers/320:00:243
132989942,2cyclictest702-21snmpd20:15:453
132989942,2cyclictest21990-21cat19:30:173
132989941,1cyclictest13958-21cat21:49:593
132899944,0cyclictest329-21hwrng23:54:371
132899943,1cyclictest702-21snmpd19:40:441
132829944,0cyclictest702-21snmpd23:16:290
132829944,0cyclictest702-21snmpd23:10:060
132829944,0cyclictest702-21snmpd23:10:060
132829944,0cyclictest702-21snmpd21:04:170
132829944,0cyclictest6189-21gltestperf20:10:170
132829944,0cyclictest329-21hwrng23:49:300
132829944,0cyclictest329-21hwrng22:11:120
132829944,0cyclictest329-21hwrng21:51:440
132829944,0cyclictest329-21hwrng19:15:030
132829943,1cyclictest702-21snmpd23:43:100
132829943,1cyclictest702-21snmpd22:50:460
132829943,1cyclictest702-21snmpd00:27:480
132829943,1cyclictest32524-21sensors_temp23:50:210
132829943,1cyclictest151ktimers/021:15:240
132829942,2cyclictest702-21snmpd20:19:590
132829942,2cyclictest28863-21ld19:45:180
132829942,2cyclictest26625-21awk22:20:120
132829942,2cyclictest26061-21cat19:40:160
132829942,2cyclictest13934-21sed23:05:190
132829940,4cyclictest3575-21turbostat21:25:000
132989933,0cyclictest329-21hwrng23:40:173
132989933,0cyclictest329-21hwrng23:30:023
132989932,1cyclictest702-21snmpd22:00:243
132989932,1cyclictest431ktimers/321:43:293
132989932,1cyclictest431ktimers/320:13:513
132989932,1cyclictest13676-21grep19:10:133
132989930,2cyclictest14656-21ntpq20:30:173
132829933,0cyclictest329-21hwrng20:29:490
132829933,0cyclictest329-21hwrng19:50:540
132829933,0cyclictest0-21swapper/000:25:000
132829932,1cyclictest25847-21cat23:35:140
132829932,1cyclictest24952-21sshd19:35:270
132829932,1cyclictest24460-21cat20:55:160
132829932,1cyclictest16738-21perl21:55:140
132829931,2cyclictest6012-21grep21:30:120
132829931,2cyclictest10971-21cat20:20:220
132829930,3cyclictest17150-21/usr/sbin/munin20:35:220
132829920,2cyclictest13996-21grep20:30:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional