You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 05:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Sat Mar 21, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2202991818,0cyclictest59550irq/125-lan20:57:441
2202991817,1cyclictest59550irq/125-lan19:25:101
2202991717,0cyclictest59550irq/125-lan23:37:191
2202991717,0cyclictest59550irq/125-lan22:34:441
2202991717,0cyclictest59550irq/125-lan20:18:341
2202991716,1cyclictest59550irq/125-lan23:15:141
2202991716,1cyclictest59550irq/125-lan22:35:201
2202991716,1cyclictest59550irq/125-lan21:50:441
2202991716,1cyclictest59550irq/125-lan21:45:161
2202991716,1cyclictest59550irq/125-lan20:50:181
2202991716,1cyclictest59550irq/125-lan00:05:171
2202991615,1cyclictest59550irq/125-lan23:45:141
2202991615,1cyclictest59550irq/125-lan23:40:201
2202991615,1cyclictest59550irq/125-lan22:55:221
2202991615,1cyclictest59550irq/125-lan22:40:201
2202991615,1cyclictest59550irq/125-lan22:20:001
2202991615,1cyclictest59550irq/125-lan21:30:111
2202991615,1cyclictest59550irq/125-lan21:15:161
2202991615,1cyclictest59550irq/125-lan00:35:141
2202991515,0cyclictest59550irq/125-lan23:10:121
2202991515,0cyclictest59550irq/125-lan22:07:441
2202991514,1cyclictest59550irq/125-lan23:50:161
2202991514,1cyclictest59550irq/125-lan23:25:131
2202991514,1cyclictest59550irq/125-lan23:20:111
2202991514,1cyclictest59550irq/125-lan23:00:151
2202991514,1cyclictest59550irq/125-lan22:50:211
2202991514,1cyclictest59550irq/125-lan21:20:121
2202991514,1cyclictest59550irq/125-lan19:50:181
2202991514,1cyclictest59550irq/125-lan19:45:141
2202991514,1cyclictest59550irq/125-lan00:15:111
2202991414,0cyclictest59550irq/125-lan23:31:411
2202991414,0cyclictest59550irq/125-lan22:10:191
2202991414,0cyclictest59550irq/125-lan21:10:141
2202991414,0cyclictest59550irq/125-lan20:20:131
2202991414,0cyclictest59550irq/125-lan20:06:051
2202991413,1cyclictest59550irq/125-lan22:45:171
2202991413,1cyclictest59550irq/125-lan20:40:161
2202991413,1cyclictest59550irq/125-lan00:25:141
2194991414,0cyclictest325-21hwrng21:10:110
2202991313,0cyclictest59550irq/125-lan00:00:131
2202991312,1cyclictest59550irq/125-lan21:55:161
2202991312,1cyclictest59550irq/125-lan19:58:231
2202991312,1cyclictest59550irq/125-lan19:40:201
2202991312,1cyclictest59550irq/125-lan19:20:191
2194991313,0cyclictest325-21hwrng20:45:370
2202991212,0cyclictest59550irq/125-lan21:00:151
2202991212,0cyclictest59550irq/125-lan20:35:141
2202991212,0cyclictest59550irq/125-lan20:35:141
2202991212,0cyclictest59550irq/125-lan20:10:111
2202991211,1cyclictest59550irq/125-lan21:05:141
2202991211,1cyclictest59550irq/125-lan20:30:161
2202991211,1cyclictest59550irq/125-lan00:30:181
221199118,3cyclictest674-21snmpd21:22:513
221199111,5cyclictest6734-21sort22:00:123
2202991111,0cyclictest59550irq/125-lan20:45:121
2202991110,1cyclictest59550irq/125-lan23:05:131
2202991110,1cyclictest59550irq/125-lan22:25:121
2202991110,1cyclictest59550irq/125-lan21:35:221
2202991110,1cyclictest59550irq/125-lan19:35:161
2202991110,1cyclictest59550irq/125-lan00:20:151
2194991111,0cyclictest325-21hwrng23:17:100
2211991010,0cyclictest325-21hwrng21:49:063
220299109,1cyclictest59550irq/125-lan20:00:161
220299109,1cyclictest59550irq/125-lan19:30:161
220299109,1cyclictest59550irq/125-lan19:20:001
220299109,1cyclictest59550irq/125-lan00:10:131
2194991010,0cyclictest325-21hwrng20:30:150
22119999,0cyclictest325-21hwrng23:31:303
22119999,0cyclictest325-21hwrng22:40:183
22119998,1cyclictest674-21snmpd23:46:293
22119997,2cyclictest674-21snmpd21:50:293
22119997,2cyclictest10543-21dump-pmu-power19:30:003
22119993,5cyclictest0-21swapper/321:39:593
22119990,6cyclictest0-21swapper/320:33:013
22119990,5cyclictest7921-21sed20:40:213
22119990,4cyclictest4791-21basename19:15:113
22069998,1cyclictest674-21snmpd22:56:212
22069998,1cyclictest674-21snmpd20:24:102
22029999,0cyclictest59550irq/125-lan22:01:131
21949999,0cyclictest325-21hwrng20:50:440
21949998,1cyclictest325-21hwrng23:57:060
22119988,0cyclictest674-21snmpd22:59:363
22119988,0cyclictest674-21snmpd19:22:233
22119987,1cyclictest674-21snmpd20:11:373
22119986,2cyclictest674-21snmpd22:15:353
22119986,2cyclictest674-21snmpd21:17:363
22119981,6cyclictest25392-21tune2fs21:25:123
22119980,4cyclictest441-21cut21:44:593
22119980,4cyclictest3782-21grep00:30:223
22119980,4cyclictest31453-21grep00:20:133
22119980,4cyclictest21805-21ld23:55:183
22119980,4cyclictest17702-21sed21:05:143
22119980,4cyclictest14901-21sendmail-msp21:00:003
22119980,4cyclictest10887-21cut22:10:123
22069988,0cyclictest674-21snmpd21:32:062
22069988,0cyclictest674-21snmpd21:05:502
22069988,0cyclictest325-21hwrng23:41:452
22069988,0cyclictest325-21hwrng23:39:412
22069988,0cyclictest325-21hwrng23:07:572
22069988,0cyclictest325-21hwrng23:01:482
22069988,0cyclictest325-21hwrng22:51:342
22069988,0cyclictest325-21hwrng21:14:172
22069988,0cyclictest325-21hwrng20:44:352
22069988,0cyclictest325-21hwrng20:26:092
22069988,0cyclictest325-21hwrng20:11:492
22069988,0cyclictest325-21hwrng20:09:462
22069988,0cyclictest325-21hwrng19:27:472
22069986,2cyclictest674-21snmpd22:30:142
22029988,0cyclictest59550irq/125-lan21:42:191
22029987,1cyclictest59550irq/125-lan23:55:121
21949988,0cyclictest674-21snmpd23:21:040
21949988,0cyclictest674-21snmpd22:45:210
21949988,0cyclictest674-21snmpd22:04:040
21949988,0cyclictest674-21snmpd21:47:370
21949988,0cyclictest674-21snmpd21:44:340
21949988,0cyclictest674-21snmpd21:01:590
21949988,0cyclictest674-21snmpd19:54:060
21949988,0cyclictest674-21snmpd19:26:480
21949988,0cyclictest325-21hwrng23:48:540
21949988,0cyclictest325-21hwrng22:44:240
21949988,0cyclictest325-21hwrng22:27:000
21949988,0cyclictest325-21hwrng22:24:560
21949988,0cyclictest325-21hwrng21:51:090
21949988,0cyclictest325-21hwrng21:24:310
21949988,0cyclictest325-21hwrng21:05:050
21949988,0cyclictest325-21hwrng20:58:550
21949988,0cyclictest325-21hwrng20:03:380
21949988,0cyclictest325-21hwrng00:39:050
21949988,0cyclictest325-21hwrng00:31:560
21949988,0cyclictest325-21hwrng00:26:470
21949988,0cyclictest325-21hwrng00:20:390
21949988,0cyclictest325-21hwrng00:07:200
21949987,1cyclictest325-21hwrng19:57:290
21949987,1cyclictest325-21hwrng19:41:060
22119977,0cyclictest674-21snmpd22:35:453
22119977,0cyclictest674-21snmpd19:11:083
22119976,1cyclictest674-21snmpd20:20:523
22119976,1cyclictest674-21snmpd19:48:123
22119976,1cyclictest674-21snmpd19:37:483
22119976,1cyclictest674-21snmpd00:38:523
22119976,1cyclictest325-21hwrng19:40:043
22119975,2cyclictest674-21snmpd23:36:413
22119975,2cyclictest31881-21cat23:00:133
22119974,3cyclictest674-21snmpd20:38:443
22119974,3cyclictest674-21snmpd20:38:443
22119970,6cyclictest26475-21latency_hist20:10:013
22119970,5cyclictest27902-21pluginstate22:50:183
22119970,5cyclictest11579-21expr20:50:163
22119970,4cyclictest976-21grep20:25:153
22119970,4cyclictest0-21swapper/322:25:183
22119970,3cyclictest27869-21ntpq21:30:153
22119970,3cyclictest0-21swapper/321:10:153
22119970,3cyclictest0-21swapper/319:30:113
22069977,0cyclictest674-21snmpd23:28:202
22069977,0cyclictest674-21snmpd23:14:082
22069977,0cyclictest674-21snmpd21:57:522
22069977,0cyclictest674-21snmpd21:40:552
22069977,0cyclictest674-21snmpd21:20:342
22069977,0cyclictest674-21snmpd19:50:302
22069977,0cyclictest674-21snmpd00:35:222
22069977,0cyclictest325-21hwrng23:30:282
22069977,0cyclictest325-21hwrng21:35:482
22069977,0cyclictest325-21hwrng21:25:332
22069977,0cyclictest325-21hwrng20:38:262
22069977,0cyclictest325-21hwrng20:38:262
22069977,0cyclictest325-21hwrng20:34:212
22069977,0cyclictest325-21hwrng19:38:022
22069977,0cyclictest325-21hwrng19:30:512
22069976,1cyclictest674-21snmpd22:01:042
22029976,1cyclictest59550irq/125-lan22:15:101
22029976,1cyclictest59550irq/125-lan19:10:141
21949977,0cyclictest674-21snmpd23:50:170
21949977,0cyclictest674-21snmpd23:40:290
21949977,0cyclictest674-21snmpd21:34:570
21949977,0cyclictest674-21snmpd21:16:270
21949977,0cyclictest674-21snmpd20:18:400
21949977,0cyclictest325-21hwrng23:11:020
21949977,0cyclictest325-21hwrng22:57:430
21949977,0cyclictest325-21hwrng22:30:030
21949977,0cyclictest325-21hwrng22:06:300
21949977,0cyclictest325-21hwrng20:35:230
21949977,0cyclictest325-21hwrng20:35:220
21949977,0cyclictest325-21hwrng20:29:150
21949977,0cyclictest325-21hwrng19:17:330
21949977,0cyclictest325-21hwrng00:02:130
21949976,1cyclictest674-21snmpd19:13:290
21949970,5cyclictest12360-21turbostat22:15:000
22119966,0cyclictest674-21snmpd00:12:253
22119966,0cyclictest325-21hwrng20:45:373
22119964,2cyclictest674-21snmpd21:56:163
22119963,3cyclictest674-21snmpd22:49:543
22119961,4cyclictest21059-21tail19:55:143
22119961,4cyclictest0-21swapper/320:00:123
22119960,5cyclictest8666-21grep22:05:123
22119960,5cyclictest7220-21grep23:20:123
22119960,5cyclictest3332-21head23:10:113
22119960,5cyclictest29197-21cut00:15:123
22119960,5cyclictest26209-21grep00:05:203
22119960,5cyclictest19255-21perl23:50:123
22119960,5cyclictest19173-21cpuspeed_turbos22:30:103
22119960,5cyclictest18943-21forks19:50:133
22119960,3cyclictest490-21/usr/sbin/munin00:25:203
22119960,3cyclictest29121-21smartctl20:15:133
22119960,3cyclictest16960-21sed21:05:003
22069966,0cyclictest674-21snmpd22:12:022
22069966,0cyclictest674-21snmpd19:58:362
22069966,0cyclictest325-21hwrng21:16:202
22069966,0cyclictest325-21hwrng21:00:582
22069966,0cyclictest325-21hwrng20:57:542
22069966,0cyclictest325-21hwrng20:50:442
22069966,0cyclictest325-21hwrng20:47:392
22069965,1cyclictest674-21snmpd22:48:512
22069965,1cyclictest674-21snmpd22:35:562
22069965,1cyclictest674-21snmpd22:22:022
22069965,1cyclictest674-21snmpd21:47:492
22069965,1cyclictest674-21snmpd00:18:032
22069965,1cyclictest674-21snmpd00:03:242
22029966,0cyclictest325-21hwrng21:28:371
21949966,0cyclictest674-21snmpd21:36:540
21949966,0cyclictest325-21hwrng23:08:580
21949965,1cyclictest674-21snmpd22:51:300
21949965,1cyclictest674-21snmpd19:22:530
21949965,1cyclictest674-21snmpd00:11:570
21949965,1cyclictest17204-21cat19:45:130
21949960,6cyclictest6396-21ls21:59:590
22119951,4cyclictest15542-21cut22:20:153
22119950,5cyclictest8999-21awk23:25:113
22119950,5cyclictest6703-21chrt23:19:443
22119950,5cyclictest23704-21ntpq00:00:153
22119950,5cyclictest1873-21ntpq23:05:153
22069955,0cyclictest674-21snmpd22:19:052
22069955,0cyclictest674-21snmpd19:16:052
22069955,0cyclictest674-21snmpd00:33:252
22069955,0cyclictest674-21snmpd00:21:032
22069954,1cyclictest674-21snmpd20:02:222
22069954,1cyclictest674-21snmpd19:41:122
21949955,0cyclictest674-21snmpd21:26:510
21949954,1cyclictest674-21snmpd22:36:230
22119940,4cyclictest15066-21wc23:40:123
22069944,0cyclictest674-21snmpd23:22:192
22069944,0cyclictest674-21snmpd00:25:102
22069944,0cyclictest325-21hwrng19:24:432
22069943,1cyclictest674-21snmpd23:45:292
22069943,1cyclictest674-21snmpd23:15:462
22069943,1cyclictest674-21snmpd00:05:482
22069943,1cyclictest3146-21ntpq19:10:142
22029942,2cyclictest436-21diskstats20:25:121
21949944,0cyclictest325-21hwrng22:15:430
21949943,1cyclictest674-21snmpd19:34:270
21949943,1cyclictest29095-21cpuspeed_turbos00:15:110
21949942,2cyclictest674-21snmpd20:21:340
21949940,4cyclictest7971-21sed20:40:210
22069932,1cyclictest674-21snmpd23:52:562
22069932,1cyclictest674-21snmpd21:50:232
22069932,1cyclictest652-21ntpd22:05:172
22069932,1cyclictest23885-21ntpq22:40:152
22069932,1cyclictest0-21swapper/220:15:122
22069931,2cyclictest674-21snmpd00:10:312
22069931,2cyclictest351ktimers/222:25:112
22069930,3cyclictest0-21swapper/223:55:132
22069930,3cyclictest0-21swapper/219:45:122
21949932,1cyclictest674-21snmpd23:39:350
21949932,1cyclictest674-21snmpd19:35:150
21949931,2cyclictest25065-21expr20:05:140
21949931,2cyclictest11326-21grep23:30:130
21949931,2cyclictest10443-21sshd23:26:310
21949930,1cyclictest477-21NetworkManager23:00:010
21949930,1cyclictest0-21swapper/020:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional