You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 16:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Mar 22, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
564099270,1cyclictest797-21ssh09:11:501
565099260,25cyclictest23350-21runrttasks10:37:073
565099260,1cyclictest0-21swapper/309:20:333
565099260,1cyclictest0-21swapper/309:11:503
5640992621,4cyclictest31831-21diskmemload10:06:141
564099260,1cyclictest10317-21ssh09:20:331
5650992521,4cyclictest9175-21ssh09:51:343
5650992521,3cyclictest0-21swapper/312:18:583
565099250,25cyclictest0-21swapper/310:49:283
565099250,24cyclictest0-21swapper/311:48:073
565099250,24cyclictest0-21swapper/310:42:213
565099250,1cyclictest8213-21apt-get11:25:013
565099250,0cyclictest0-21swapper/310:17:393
565099250,0cyclictest0-21swapper/309:45:473
5640992521,3cyclictest31663-21ssh12:18:581
5640992521,3cyclictest0-21swapper/109:51:341
564099250,25cyclictest0-21swapper/110:49:281
564099250,25cyclictest0-21swapper/110:21:451
564099250,24cyclictest0-21swapper/110:00:451
564099250,21cyclictest0-21swapper/111:43:581
564099250,1cyclictest18326-21ssh11:34:181
564099250,1cyclictest0-21swapper/110:37:071
564099250,1cyclictest0-21swapper/109:37:161
564099250,0cyclictest0-21swapper/111:25:011
564099250,0cyclictest0-21swapper/109:45:471
5635992523,1cyclictest0-21swapper/012:02:150
5650992420,4cyclictest0-21swapper/310:05:493
5650992420,3cyclictest0-21swapper/311:51:183
5650992420,3cyclictest0-21swapper/311:17:243
565099240,24cyclictest0-21swapper/312:06:393
565099240,24cyclictest0-21swapper/310:21:453
565099240,23cyclictest0-21swapper/310:27:553
565099240,23cyclictest0-21swapper/310:00:453
565099240,23cyclictest0-21swapper/309:56:573
565099240,23cyclictest0-21swapper/309:37:083
565099240,23cyclictest0-21swapper/309:33:553
565099240,20cyclictest0-21swapper/311:56:023
565099240,20cyclictest0-21swapper/310:56:033
565099240,1cyclictest8855-21ssh12:28:003
565099240,0cyclictest0-21swapper/311:31:083
565099240,0cyclictest0-21swapper/309:27:463
564599240,24cyclictest0-21swapper/211:39:542
564599240,23cyclictest700-21sh12:20:592
564599240,23cyclictest31831-21diskmemload10:15:582
564599240,0cyclictest31831-21diskmemload09:32:292
5640992421,3cyclictest0-21swapper/112:24:471
5640992420,4cyclictest31831-21diskmemload11:51:181
5640992420,4cyclictest31831-21diskmemload11:17:241
5640992420,3cyclictest31831-21diskmemload09:57:371
564099240,24cyclictest31831-21diskmemload11:48:071
564099240,24cyclictest0-21swapper/112:36:321
564099240,24cyclictest0-21swapper/112:06:391
564099240,24cyclictest0-21swapper/111:56:021
564099240,24cyclictest0-21swapper/111:04:551
564099240,24cyclictest0-21swapper/110:42:211
564099240,23cyclictest17214-21sh10:31:001
564099240,20cyclictest0-21swapper/111:05:011
564099240,0cyclictest0-21swapper/112:25:191
563599240,23cyclictest7265-21sh09:48:580
563599240,23cyclictest31831-21diskmemload09:23:290
563599240,23cyclictest25298-21awk07:50:010
563599240,23cyclictest0-21swapper/012:05:320
563599240,23cyclictest0-21swapper/010:57:490
563599240,23cyclictest0-21swapper/010:17:440
563599240,23cyclictest0-21swapper/009:37:310
5650992323,0cyclictest0-21swapper/310:13:183
5650992321,2cyclictest0-21swapper/312:13:053
5650992320,3cyclictest0-21swapper/311:00:173
5650992319,3cyclictest0-21swapper/312:31:243
5650992318,4cyclictest0-21swapper/308:52:393
565099230,23cyclictest0-21swapper/312:36:323
565099230,23cyclictest0-21swapper/311:35:303
565099230,22cyclictest31831-21diskmemload10:51:463
565099230,22cyclictest16051-21apt-get07:32:403
565099230,22cyclictest0-21swapper/311:21:053
565099230,22cyclictest0-21swapper/310:31:003
565099230,20cyclictest0-21swapper/311:05:013
565099230,0cyclictest0-21swapper/312:24:303
565099230,0cyclictest0-21swapper/309:15:473
5645992323,0cyclictest30619-21apt-get08:02:392
5645992323,0cyclictest0-21swapper/212:39:432
5645992323,0cyclictest0-21swapper/212:33:022
5645992323,0cyclictest0-21swapper/212:28:012
5645992323,0cyclictest0-21swapper/211:09:112
564599230,23cyclictest31831-21diskmemload09:50:412
564599230,23cyclictest0-21swapper/210:21:452
564599230,23cyclictest0-21swapper/209:15:222
564599230,22cyclictest9820-21sh11:26:362
564599230,22cyclictest6058-21ssh10:51:302
564599230,22cyclictest3310-21sh09:12:562
564599230,22cyclictest17654-21sh12:05:432
564599230,22cyclictest15555-21ssh10:28:432
564599230,22cyclictest15183-21tr09:57:402
564599230,0cyclictest31831-21diskmemload09:47:122
564599230,0cyclictest0-21swapper/211:20:102
564599230,0cyclictest0-21swapper/210:56:282
564599230,0cyclictest0-21swapper/209:24:012
5640992323,0cyclictest0-21swapper/110:13:181
5640992320,3cyclictest0-21swapper/112:31:241
5640992320,3cyclictest0-21swapper/112:13:051
5640992320,3cyclictest0-21swapper/111:11:311
5640992320,2cyclictest14584-21ssh10:27:481
564099230,2cyclictest22608-21apt-get08:52:391
564099230,23cyclictest0-21swapper/112:00:241
564099230,23cyclictest0-21swapper/110:51:561
564099230,23cyclictest0-21swapper/107:32:401
564099230,22cyclictest0-21swapper/108:45:011
564099230,20cyclictest31831-21diskmemload11:35:301
564099230,1cyclictest0-21swapper/110:55:191
564099230,0cyclictest2977-21apt-get10:17:391
564099230,0cyclictest0-21swapper/109:32:261
564099230,0cyclictest0-21swapper/109:15:471
5635992323,0cyclictest0-21swapper/012:36:320
5635992323,0cyclictest0-21swapper/010:51:180
5635992323,0cyclictest0-21swapper/010:10:270
5635992323,0cyclictest0-21swapper/009:29:220
563599232,21cyclictest62550irq/127-eno111:12:530
5635992321,2cyclictest30078-21ssh11:46:190
5635992321,1cyclictest0-21swapper/012:15:030
563599230,2cyclictest3108-21mailstats10:47:470
563599230,23cyclictest0-21swapper/011:31:570
563599230,22cyclictest21010-21ssh11:06:040
563599230,22cyclictest0-21swapper/012:25:380
563599230,22cyclictest0-21swapper/012:24:330
563599230,22cyclictest0-21swapper/010:02:420
563599230,22cyclictest0-21swapper/009:12:390
563599230,0cyclictest31831-21diskmemload11:40:510
563599230,0cyclictest0-21swapper/010:22:250
563599230,0cyclictest0-21swapper/009:42:210
5650992221,0cyclictest0-21swapper/307:27:383
5650992221,0cyclictest0-21swapper/307:12:383
5650992220,2cyclictest0-21swapper/311:11:313
565099220,21cyclictest606-21dbus-daemon08:50:013
565099220,1cyclictest0-21swapper/307:22:383
565099220,0cyclictest0-21swapper/309:41:423
5645992222,0cyclictest31831-21diskmemload10:35:142
5645992222,0cyclictest0-21swapper/211:04:192
5645992222,0cyclictest0-21swapper/210:30:082
5645992220,1cyclictest18709-21idleruntime-cro11:35:002
5645992220,1cyclictest15519-21sh09:25:472
5645992220,1cyclictest12165-21basename08:30:002
564599220,22cyclictest0-21swapper/212:13:082
564599220,21cyclictest31831-21diskmemload12:02:502
564599220,21cyclictest29938-21ssh11:46:062
564599220,21cyclictest27763-21ssh10:41:002
564599220,21cyclictest0-21swapper/212:15:272
564599220,1cyclictest3191-21ssh11:52:002
564599220,1cyclictest31831-21diskmemload10:03:392
564599220,0cyclictest0-21swapper/211:10:482
5640992221,1cyclictest6050-21apt-get07:12:381
564099220,22cyclictest22139-21cron08:50:011
564099220,21cyclictest0-21swapper/111:20:091
564099220,21cyclictest0-21swapper/109:27:041
564099220,21cyclictest0-21swapper/108:37:411
564099220,0cyclictest0-21swapper/109:41:421
5635992222,0cyclictest31831-21diskmemload12:30:160
5635992222,0cyclictest0-21swapper/010:41:450
5635992221,1cyclictest62550irq/127-eno110:26:200
5635992221,1cyclictest62550irq/127-eno109:55:010
5635992221,1cyclictest0-21swapper/011:55:170
5635992221,1cyclictest0-21swapper/007:37:410
5635992220,1cyclictest19139-21ssh11:35:160
563599220,22cyclictest0-21swapper/011:15:060
563599220,21cyclictest606-21dbus-daemon07:15:010
563599220,21cyclictest31831-21diskmemload09:50:150
563599220,21cyclictest22933-21sh12:11:030
563599220,21cyclictest0-21swapper/011:02:440
563599220,21cyclictest0-21swapper/010:35:080
563599220,21cyclictest0-21swapper/010:05:030
563599220,21cyclictest0-21swapper/007:57:400
563599220,1cyclictest8565-21ssh09:18:100
563599220,1cyclictest7401-21kworker/u8:110:30:010
563599220,1cyclictest0-21swapper/011:25:020
563599220,1cyclictest0-21swapper/011:22:290
563599220,1cyclictest0-21swapper/009:33:420
565099210,21cyclictest0-21swapper/308:20:003
565099210,20cyclictest15406-21apt-get08:37:413
565099210,20cyclictest0-21swapper/307:17:413
565099210,0cyclictest0-21swapper/308:22:393
5645992121,0cyclictest0-21swapper/209:37:092
5645992121,0cyclictest0-21swapper/209:07:392
5645992120,1cyclictest7822-21apt-get08:22:392
5645992120,1cyclictest7114-21ssh11:55:112
5645992119,1cyclictest23591-21rm10:05:102
564599210,21cyclictest0-21swapper/210:45:372
564599210,21cyclictest0-21swapper/207:27:382
564599210,20cyclictest31831-21diskmemload10:10:222
564599210,20cyclictest17822-21apt-get08:42:412
564599210,20cyclictest0-21swapper/207:15:012
564599210,1cyclictest24389-21ssh11:40:282
5640992121,0cyclictest0-21swapper/107:27:381
564099210,21cyclictest8846-21apt-get07:17:411
564099210,21cyclictest0-21swapper/108:20:001
564099210,0cyclictest0-21swapper/108:22:391
564099210,0cyclictest0-21swapper/108:02:391
564099210,0cyclictest0-21swapper/107:22:381
5635992121,0cyclictest0-21swapper/008:37:410
5635992121,0cyclictest0-21swapper/008:27:410
5635992120,1cyclictest9766-21perf08:25:000
5635992120,1cyclictest0-21swapper/007:52:390
563599210,21cyclictest0-21swapper/011:50:060
5650992020,0cyclictest0-21swapper/308:10:003
565099200,0cyclictest0-21swapper/308:02:393
5645992020,0cyclictest0-21swapper/207:17:402
5645992019,1cyclictest24566-21cron08:55:012
564599200,0cyclictest0-21swapper/208:57:422
564599200,0cyclictest0-21swapper/207:37:412
5640992020,0cyclictest0-21swapper/108:10:001
5640992019,1cyclictest29917-21apt-get09:07:391
5640992019,1cyclictest25057-21apt-get08:57:421
5635992020,0cyclictest0-21swapper/008:57:420
5635992020,0cyclictest0-21swapper/008:42:410
5635992020,0cyclictest0-21swapper/008:17:390
5635992018,1cyclictest22906-21grep07:45:010
5650991919,0cyclictest0-21swapper/309:07:393
5650991919,0cyclictest0-21swapper/308:57:423
5650991918,0cyclictest27469-21apt-get09:02:393
5650991917,1cyclictest4929-21apt08:15:003
5645991919,0cyclictest2999-21apt-get08:12:392
5645991919,0cyclictest11259-21apt-get07:22:382
5645991918,1cyclictest17369-21perf08:40:012
5640991918,1cyclictest0-21swapper/109:02:391
5640991917,1cyclictest0-21swapper/108:15:001
5635991919,0cyclictest0-21swapper/008:32:380
5635991919,0cyclictest0-21swapper/008:12:390
5635991919,0cyclictest0-21swapper/007:27:380
5635991917,1cyclictest0-21swapper/007:15:020
5650991813,0cyclictest0-21swapper/307:47:393
5645991817,1cyclictest17998-21munin-run07:35:002
564599180,1cyclictest774-21runrttasks07:52:392
5640991817,1cyclictest23361-21apt-get07:47:391
5640991816,1cyclictest0-21swapper/107:45:011
5635991818,0cyclictest0-21swapper/008:52:390
5635991818,0cyclictest0-21swapper/007:22:380
5635991816,1cyclictest313-21systemd-journal09:05:000
5650991717,0cyclictest0-21swapper/307:57:403
5650991717,0cyclictest0-21swapper/307:37:413
5650991716,1cyclictest25753-21apt-get07:52:403
5650991715,1cyclictest22896-21latency_hist07:45:013
5645991717,0cyclictest0-21swapper/208:17:392
5640991717,0cyclictest0-21swapper/107:57:401
5640991717,0cyclictest0-21swapper/107:37:411
5640991716,1cyclictest10218-21apt-get08:27:411
5635991717,0cyclictest0-21swapper/009:07:390
5635991717,0cyclictest0-21swapper/008:02:390
5645991615,0cyclictest0-21swapper/207:47:392
5640991616,0cyclictest0-21swapper/107:52:401
563599164,11cyclictest793-21lldpd07:33:140
5635991613,2cyclictest606-21dbus-daemon08:50:010
5650991515,0cyclictest0-21swapper/308:32:393
5650991515,0cyclictest0-21swapper/308:27:413
5645991514,1cyclictest14633-21cut08:35:012
564599150,1cyclictest27708-21expr09:02:392
5640991515,0cyclictest0-21swapper/108:32:391
563599150,1cyclictest0-21swapper/008:07:410
565099140,0cyclictest0-21swapper/308:40:233
564599140,14cyclictest0-21swapper/207:40:092
564599140,0cyclictest0-21swapper/208:47:032
564599140,0cyclictest0-21swapper/208:05:102
564599140,0cyclictest0-21swapper/207:55:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional