You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 09:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot7.osadl.org (updated Sat Nov 15, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25380991918,1cyclictest60250irq/125-lan22:30:002
25380991918,1cyclictest60250irq/125-lan21:00:172
25380991918,1cyclictest60250irq/125-lan20:10:142
25380991817,1cyclictest60250irq/125-lan21:58:442
25380991817,1cyclictest60250irq/125-lan21:18:172
25380991817,1cyclictest60250irq/125-lan19:45:252
25380991717,0cyclictest60250irq/125-lan23:15:202
25380991717,0cyclictest60250irq/125-lan20:55:452
25380991716,1cyclictest60250irq/125-lan22:15:132
25380991716,1cyclictest60250irq/125-lan21:50:182
25380991716,1cyclictest60250irq/125-lan21:45:142
25380991716,1cyclictest60250irq/125-lan20:06:502
25380991716,1cyclictest60250irq/125-lan19:31:442
25380991716,1cyclictest60250irq/125-lan19:15:122
25380991716,1cyclictest60250irq/125-lan00:20:132
25380991716,1cyclictest60250irq/125-lan00:00:202
25380991715,2cyclictest60250irq/125-lan20:30:152
25380991715,2cyclictest60250irq/125-lan20:25:172
25380991616,0cyclictest60250irq/125-lan21:12:442
25380991616,0cyclictest60250irq/125-lan20:15:112
25380991616,0cyclictest60250irq/125-lan19:35:442
25380991615,1cyclictest60250irq/125-lan22:25:142
25380991615,1cyclictest60250irq/125-lan22:20:132
25380991615,1cyclictest60250irq/125-lan22:05:142
25380991613,2cyclictest60250irq/125-lan00:10:222
25380991515,0cyclictest60250irq/125-lan23:55:192
25380991515,0cyclictest60250irq/125-lan23:00:192
25380991515,0cyclictest60250irq/125-lan22:55:012
25380991515,0cyclictest60250irq/125-lan22:10:142
25380991515,0cyclictest60250irq/125-lan20:04:452
25380991515,0cyclictest60250irq/125-lan19:28:432
25380991515,0cyclictest60250irq/125-lan19:22:452
25380991514,1cyclictest60250irq/125-lan23:50:132
25380991514,1cyclictest60250irq/125-lan23:45:202
25380991514,1cyclictest60250irq/125-lan23:40:152
25380991514,1cyclictest60250irq/125-lan23:30:222
25380991514,1cyclictest60250irq/125-lan23:20:132
25380991514,1cyclictest60250irq/125-lan22:35:182
25380991514,1cyclictest60250irq/125-lan21:40:152
25380991514,1cyclictest60250irq/125-lan21:35:202
25380991514,1cyclictest60250irq/125-lan21:20:222
25380991514,1cyclictest60250irq/125-lan20:50:152
25380991514,1cyclictest60250irq/125-lan00:30:192
25371991515,0cyclictest329-21hwrng22:58:020
25371991515,0cyclictest329-21hwrng21:43:170
25371991515,0cyclictest329-21hwrng21:36:070
25380991414,0cyclictest60250irq/125-lan21:09:442
25380991414,0cyclictest60250irq/125-lan19:40:122
25380991413,1cyclictest60250irq/125-lan22:40:172
25380991413,1cyclictest60250irq/125-lan21:30:232
25380991413,1cyclictest60250irq/125-lan21:25:132
25380991413,1cyclictest60250irq/125-lan20:40:162
25380991413,1cyclictest60250irq/125-lan00:35:182
25371991414,0cyclictest702-21snmpd20:24:170
25371991414,0cyclictest329-21hwrng23:45:090
25371991414,0cyclictest329-21hwrng23:44:070
25371991414,0cyclictest329-21hwrng23:27:440
25371991414,0cyclictest329-21hwrng22:38:350
25371991414,0cyclictest329-21hwrng22:16:030
25371991414,0cyclictest329-21hwrng21:56:360
25371991414,0cyclictest329-21hwrng21:11:330
25371991414,0cyclictest329-21hwrng21:09:300
25371991414,0cyclictest329-21hwrng20:50:020
25371991414,0cyclictest329-21hwrng19:38:220
25380991313,0cyclictest60250irq/125-lan23:36:442
25380991313,0cyclictest60250irq/125-lan00:28:182
25380991313,0cyclictest329-21hwrng19:14:482
25380991313,0cyclictest329-21hwrng00:06:392
25380991312,1cyclictest60250irq/125-lan23:25:152
25380991312,1cyclictest60250irq/125-lan22:50:002
25380991312,1cyclictest60250irq/125-lan22:00:202
25380991312,1cyclictest60250irq/125-lan20:35:152
25380991312,1cyclictest60250irq/125-lan20:20:212
25371991313,0cyclictest329-21hwrng23:11:210
25371991313,0cyclictest329-21hwrng22:05:490
25371991313,0cyclictest329-21hwrng21:16:400
25371991313,0cyclictest329-21hwrng20:41:510
25380991212,0cyclictest60250irq/125-lan19:55:182
25380991211,1cyclictest60250irq/125-lan20:45:162
25371991212,0cyclictest329-21hwrng22:30:230
25371991212,0cyclictest329-21hwrng22:22:120
25371991212,0cyclictest329-21hwrng21:49:260
25380991111,0cyclictest60250irq/125-lan19:54:442
25380991110,1cyclictest60250irq/125-lan23:10:202
25380991110,1cyclictest60250irq/125-lan23:05:152
25371991111,0cyclictest329-21hwrng23:07:140
25371991111,0cyclictest329-21hwrng00:35:190
25385991010,0cyclictest329-21hwrng00:20:593
25380991010,0cyclictest60250irq/125-lan00:15:192
253859998,1cyclictest702-21snmpd22:34:593
253809999,0cyclictest60250irq/125-lan22:45:122
253719999,0cyclictest329-21hwrng00:29:100
253859988,0cyclictest702-21snmpd19:24:213
253859988,0cyclictest702-21snmpd00:19:253
253859988,0cyclictest329-21hwrng23:53:203
253859988,0cyclictest329-21hwrng23:19:323
253859988,0cyclictest329-21hwrng23:03:103
253859988,0cyclictest329-21hwrng22:50:523
253859988,0cyclictest329-21hwrng22:46:453
253859988,0cyclictest329-21hwrng22:42:413
253859988,0cyclictest329-21hwrng21:53:323
253859988,0cyclictest329-21hwrng21:32:013
253859988,0cyclictest329-21hwrng20:48:003
253859988,0cyclictest329-21hwrng20:30:353
253859988,0cyclictest329-21hwrng20:29:343
253859988,0cyclictest329-21hwrng20:23:253
253859988,0cyclictest329-21hwrng19:51:403
253859988,0cyclictest329-21hwrng19:45:323
253859988,0cyclictest329-21hwrng19:41:253
253859988,0cyclictest329-21hwrng19:37:203
253859988,0cyclictest329-21hwrng00:37:223
253859988,0cyclictest329-21hwrng00:27:083
253859987,1cyclictest702-21snmpd23:59:003
253739988,0cyclictest702-21snmpd23:39:501
253739988,0cyclictest702-21snmpd21:30:241
253739988,0cyclictest702-21snmpd20:44:531
253739988,0cyclictest329-21hwrng23:55:231
253739988,0cyclictest329-21hwrng23:52:181
253739988,0cyclictest329-21hwrng23:48:131
253739988,0cyclictest329-21hwrng22:46:461
253739988,0cyclictest329-21hwrng22:20:091
253739988,0cyclictest329-21hwrng22:19:081
253739988,0cyclictest329-21hwrng20:03:571
253739988,0cyclictest329-21hwrng19:35:171
253739988,0cyclictest329-21hwrng19:34:151
253739988,0cyclictest329-21hwrng19:26:041
253739988,0cyclictest329-21hwrng00:37:221
253739987,1cyclictest702-21snmpd20:33:491
253719988,0cyclictest702-21snmpd20:34:490
253719988,0cyclictest329-21hwrng23:37:570
253719988,0cyclictest329-21hwrng23:30:480
253719988,0cyclictest329-21hwrng22:40:380
253719988,0cyclictest329-21hwrng22:25:160
253719988,0cyclictest329-21hwrng21:50:270
253719988,0cyclictest329-21hwrng21:29:590
253719988,0cyclictest329-21hwrng21:00:160
253719988,0cyclictest329-21hwrng20:46:570
253719988,0cyclictest329-21hwrng20:35:420
253719988,0cyclictest329-21hwrng20:13:110
253719988,0cyclictest329-21hwrng19:30:090
253719988,0cyclictest329-21hwrng19:27:060
253719987,1cyclictest13433-21cron23:55:000
253719986,2cyclictest702-21snmpd22:11:080
253859977,0cyclictest702-21snmpd23:37:593
253859977,0cyclictest702-21snmpd21:19:283
253859977,0cyclictest702-21snmpd21:14:063
253859977,0cyclictest702-21snmpd20:00:223
253859977,0cyclictest702-21snmpd19:33:543
253859977,0cyclictest702-21snmpd19:14:163
253859977,0cyclictest329-21hwrng23:31:503
253859977,0cyclictest329-21hwrng23:20:343
253859977,0cyclictest329-21hwrng20:50:023
253859977,0cyclictest329-21hwrng20:42:523
253859977,0cyclictest329-21hwrng20:36:443
253859977,0cyclictest329-21hwrng20:06:013
253859977,0cyclictest329-21hwrng19:55:453
253859977,0cyclictest329-21hwrng19:17:533
253859977,0cyclictest329-21hwrng00:10:443
253859976,1cyclictest8515-21dump-pmu-power22:25:003
253859976,1cyclictest702-21snmpd23:25:023
253859976,1cyclictest702-21snmpd19:27:023
253739977,0cyclictest702-21snmpd23:16:051
253739977,0cyclictest329-21hwrng23:05:121
253739977,0cyclictest329-21hwrng22:51:541
253739977,0cyclictest329-21hwrng22:37:341
253739977,0cyclictest329-21hwrng22:31:251
253739977,0cyclictest329-21hwrng22:28:211
253739977,0cyclictest329-21hwrng22:08:531
253739977,0cyclictest329-21hwrng21:56:361
253739977,0cyclictest329-21hwrng21:42:161
253739977,0cyclictest329-21hwrng21:36:071
253739977,0cyclictest329-21hwrng21:25:531
253739977,0cyclictest329-21hwrng21:20:461
253739977,0cyclictest329-21hwrng21:15:371
253739977,0cyclictest329-21hwrng21:11:331
253739977,0cyclictest329-21hwrng21:04:221
253739977,0cyclictest329-21hwrng20:57:131
253739977,0cyclictest329-21hwrng20:53:071
253739977,0cyclictest329-21hwrng20:26:291
253739977,0cyclictest329-21hwrng20:12:091
253739977,0cyclictest329-21hwrng19:51:401
253739977,0cyclictest329-21hwrng19:41:261
253739977,0cyclictest329-21hwrng19:23:001
253739977,0cyclictest329-21hwrng19:15:491
253739977,0cyclictest329-21hwrng19:11:441
253739977,0cyclictest329-21hwrng00:31:131
253739977,0cyclictest329-21hwrng00:11:461
253739977,0cyclictest329-21hwrng00:06:381
253739977,0cyclictest329-21hwrng00:01:321
253739976,1cyclictest702-21snmpd23:40:111
253719977,0cyclictest702-21snmpd21:30:220
253719977,0cyclictest702-21snmpd19:44:330
253719977,0cyclictest329-21hwrng23:18:310
253719977,0cyclictest329-21hwrng21:20:460
253719977,0cyclictest329-21hwrng20:19:180
253719977,0cyclictest329-21hwrng00:30:120
253719976,1cyclictest702-21snmpd00:01:570
253719971,0cyclictest15453-21turbostat00:00:000
253859966,0cyclictest702-21snmpd22:39:123
253859966,0cyclictest702-21snmpd21:36:253
253859966,0cyclictest702-21snmpd21:26:013
253859966,0cyclictest702-21snmpd21:07:393
253859966,0cyclictest702-21snmpd21:00:243
253859966,0cyclictest702-21snmpd20:56:543
253859966,0cyclictest329-21hwrng23:40:013
253859966,0cyclictest329-21hwrng22:02:443
253859965,1cyclictest702-21snmpd23:05:043
253859965,1cyclictest702-21snmpd20:10:393
253739966,0cyclictest702-21snmpd22:00:111
253739966,0cyclictest329-21hwrng22:14:001
253739966,0cyclictest329-21hwrng00:15:521
253739965,1cyclictest702-21snmpd21:51:411
253739965,1cyclictest702-21snmpd21:08:451
253739965,1cyclictest702-21snmpd20:38:021
253739965,1cyclictest702-21snmpd00:25:281
253719966,0cyclictest702-21snmpd19:53:580
253719966,0cyclictest702-21snmpd19:18:310
253719965,1cyclictest702-21snmpd20:57:540
253719965,1cyclictest702-21snmpd19:49:570
253719965,1cyclictest702-21snmpd00:11:520
253859955,0cyclictest702-21snmpd22:55:133
253859955,0cyclictest329-21hwrng22:16:023
253859955,0cyclictest329-21hwrng20:16:153
253859954,1cyclictest702-21snmpd23:12:563
253859954,1cyclictest702-21snmpd21:47:063
253859954,1cyclictest702-21snmpd00:05:183
253859954,1cyclictest10026-21gltestperf23:45:143
253739955,0cyclictest702-21snmpd19:56:371
253739955,0cyclictest329-21hwrng19:45:311
253739954,1cyclictest702-21snmpd23:31:291
253739954,1cyclictest702-21snmpd22:58:461
253719955,0cyclictest702-21snmpd23:02:550
253719954,1cyclictest702-21snmpd20:28:290
253719954,1cyclictest680-21ntpd19:20:200
253719954,1cyclictest17335-21cat22:45:150
253719954,1cyclictest0-21swapper/022:00:160
253719950,5cyclictest14078-21sendmail20:00:000
253859943,1cyclictest702-21snmpd21:43:283
253859942,2cyclictest29703-21ntpq21:55:173
253739944,0cyclictest702-21snmpd20:24:471
253739944,0cyclictest329-21hwrng23:01:071
253739944,0cyclictest329-21hwrng20:06:011
253739944,0cyclictest329-21hwrng00:23:021
253739943,1cyclictest702-21snmpd20:47:531
253739941,1cyclictest16608-21cron22:45:001
253719943,1cyclictest702-21snmpd19:12:140
253719943,1cyclictest702-21snmpd00:21:370
253719942,2cyclictest702-21snmpd23:22:530
253719942,2cyclictest702-21snmpd00:07:360
253859932,1cyclictest899-21grep22:05:143
253859932,1cyclictest702-21snmpd00:00:123
253859931,2cyclictest9133-21expr22:25:143
253859931,2cyclictest15101-21sh21:20:203
253859930,3cyclictest2358-21turbostat22:14:553
253739932,1cyclictest21043-21needreboot20:15:151
253739932,1cyclictest0-21swapper/123:20:151
253739931,2cyclictest27644-21cut23:10:141
253739931,2cyclictest25438-21wc21:45:161
253739931,2cyclictest1087-21apt-get23:25:141
253719932,1cyclictest19660-21ntpq22:50:160
253719932,1cyclictest191rcuc/020:00:130
253719932,1cyclictest16524-21df20:05:150
253719920,2cyclictest21849-21grep00:15:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional