You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 19:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot7s.osadl.org (updated Fri Jul 10, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
987529877,17sleep10-21swapper/107:08:341
785429381,8sleep00-21swapper/007:05:080
971029264,10sleep30-21swapper/307:06:273
989629064,8sleep20-21swapper/207:08:512
1008199280,10cyclictest915-21pmu-power10:25:212
1008499260,3cyclictest0-21swapper/309:39:003
1007599250,19cyclictest0-21swapper/008:30:160
1008199242,7cyclictest22956-21df_abs07:35:152
1008199242,6cyclictest30297-21gltestperf07:50:172
1008199240,2cyclictest20977-21wc09:40:002
1008199240,15cyclictest0-21swapper/210:18:432
33032230,0sleep10-21swapper/112:04:021
33032230,0sleep10-21swapper/112:04:021
10084992323,0cyclictest0-21swapper/312:28:203
1008499232,20cyclictest29623-21kworker/3:210:40:273
1008499231,21cyclictest29623-21kworker/3:210:38:573
1008199230,22cyclictest0-21swapper/210:50:012
1008499222,19cyclictest7567-21kworker/3:108:50:473
1008499222,19cyclictest7567-21kworker/3:108:40:543
1008499222,19cyclictest7567-21kworker/3:108:39:073
1008499222,19cyclictest32631-21kworker/3:009:08:133
1008499220,20cyclictest7567-21kworker/3:108:45:213
1008499220,20cyclictest7567-21kworker/3:108:45:213
1008199225,9cyclictest12862-21grep11:30:212
1008199220,19cyclictest0-21swapper/212:33:362
1007899220,22cyclictest0-21swapper/110:17:201
1007899220,1cyclictest0-21swapper/111:06:051
1008499213,18cyclictest32631-21kworker/3:009:10:073
1008499212,18cyclictest7567-21kworker/3:109:00:413
1008499212,18cyclictest7567-21kworker/3:108:55:293
1008199215,7cyclictest20078-21grep08:35:232
1008199210,21cyclictest0-21swapper/209:43:022
1008199210,20cyclictest0-21swapper/210:07:202
10078992120,0cyclictest0-21swapper/111:52:011
1007899210,16cyclictest0-21swapper/112:21:441
1007899210,0cyclictest0-21swapper/110:29:341
1007599217,7cyclictest8597-21munin-run10:50:010
10081992011,3cyclictest5824-21wc08:05:282
1008199200,19cyclictest0-21swapper/212:13:342
1007899200,17cyclictest3020-21diskmemload10:51:381
10081991911,3cyclictest13657-21sed07:15:182
1008199190,19cyclictest0-21swapper/211:51:332
1008199190,17cyclictest0-21swapper/211:16:322
1008199190,17cyclictest0-21swapper/210:02:102
1008199190,0cyclictest0-21swapper/211:43:252
1007899192,17cyclictest0-21swapper/110:35:211
10078991918,1cyclictest0-21swapper/110:05:131
1007599197,6cyclictest17422-21perf07:25:010
10084991818,0cyclictest0-21swapper/311:35:573
10084991813,5cyclictest0-21swapper/309:24:583
1008499181,1cyclictest0-21swapper/310:29:343
1008199184,5cyclictest21208-21pmu-power11:35:212
10081991811,0cyclictest0-21swapper/212:04:432
10081991811,0cyclictest0-21swapper/212:04:422
1008199180,17cyclictest0-21swapper/210:57:512
10078991818,0cyclictest0-21swapper/112:38:241
10084991714,1cyclictest3020-21diskmemload10:48:473
1008499170,9cyclictest0-21swapper/311:54:193
1008199178,3cyclictest21001-21wc07:30:202
10081991710,2cyclictest1122-21grep07:55:282
1008199170,1cyclictest0-21swapper/212:15:452
1008199170,17cyclictest0-21swapper/212:29:582
1008199170,17cyclictest0-21swapper/209:56:202
1007899177,9cyclictest25-21ksoftirqd/111:35:211
1007899170,1cyclictest0-21swapper/108:10:181
1007599170,2cyclictest0-21swapper/011:12:170
1008499161,2cyclictest0-21swapper/312:19:303
1008199161,14cyclictest0-21swapper/211:46:542
1008199161,13cyclictest0-21swapper/212:36:382
1008199160,16cyclictest0-21swapper/211:05:582
1008199160,16cyclictest0-21swapper/210:36:512
10078991615,1cyclictest0-21swapper/109:26:031
10078991613,2cyclictest1370-21apache212:17:151
1007899160,3cyclictest0-21swapper/110:23:531
1007899160,13cyclictest0-21swapper/111:33:011
1007599165,6cyclictest12412-21apt-get07:15:000
1007599162,7cyclictest23332-21munin-run08:45:000
1007599160,14cyclictest0-21swapper/010:00:130
10084991514,1cyclictest0-21swapper/310:23:163
1008499150,14cyclictest0-21swapper/310:33:373
1008199150,3cyclictest0-21swapper/211:11:522
1008199150,15cyclictest0-21swapper/211:20:152
1008199150,15cyclictest0-21swapper/209:51:382
1008199150,10cyclictest0-21swapper/209:00:142
10078991514,1cyclictest0-21swapper/110:00:241
10078991513,1cyclictest0-21swapper/108:20:571
10078991512,2cyclictest30298-21grep07:50:171
1007599155,5cyclictest29624-21awk12:20:000
10075991515,0cyclictest0-21swapper/012:27:140
1007599150,1cyclictest0-21swapper/009:29:020
1007599150,15cyclictest0-21swapper/009:20:430
1008499145,4cyclictest1875-21apache_volume11:05:113
1008499143,6cyclictest225-21systemd-journal11:47:243
10084991414,0cyclictest0-21swapper/310:55:443
1008499141,3cyclictest0-21swapper/310:00:123
1008499141,1cyclictest141rcu_preempt12:30:213
10084991410,2cyclictest10549-21tr07:10:153
1008499140,1cyclictest0-21swapper/310:13:293
1008499140,14cyclictest0-21swapper/309:28:353
1008499140,13cyclictest22771-21grep11:55:273
1008199143,10cyclictest25153-21runrttasks11:57:162
10081991411,2cyclictest27506-21cut11:00:212
10081991411,2cyclictest14671-21cron10:15:002
1008199140,4cyclictest0-21swapper/210:49:222
1008199140,1cyclictest0-21swapper/212:22:342
1008199140,14cyclictest0-21swapper/212:09:402
1007899142,2cyclictest0-21swapper/107:45:001
1007899141,3cyclictest11271-21rm12:27:561
10078991410,3cyclictest21283-21cron12:15:011
10075991414,0cyclictest0-21swapper/012:02:380
10075991414,0cyclictest0-21swapper/012:02:380
10075991414,0cyclictest0-21swapper/009:16:280
10075991410,3cyclictest8812-21cron08:15:000
10075991410,3cyclictest28827-21grep11:40:170
10075991410,2cyclictest14870-21rm10:15:000
1007599140,14cyclictest0-21swapper/009:10:360
1007599140,12cyclictest0-21swapper/010:07:190
1008499139,3cyclictest22482-21tr07:35:143
1008499139,2cyclictest5404-21tr12:05:153
1008499137,4cyclictest27731-21fschecks_time11:20:153
10084991310,2cyclictest4822-21chrt08:05:163
10084991310,2cyclictest153282sleep311:31:533
10084991310,2cyclictest14493-21sort08:25:193
1008499130,0cyclictest0-21swapper/309:52:463
1008199139,2cyclictest15286-21wc08:25:282
1008199137,6cyclictest3500-21apache210:41:522
10081991310,2cyclictest22790-21wc08:40:272
10081991310,2cyclictest17391-21cron07:25:012
1008199130,13cyclictest0-21swapper/210:32:372
1008199130,13cyclictest0-21swapper/209:14:502
1007899139,3cyclictest31043-21kworker/1:010:49:171
1007899139,3cyclictest21440-21grep08:40:151
1007899139,3cyclictest1622-21dump-pmu-power08:00:001
1007899139,3cyclictest14664-21tr12:30:131
1007899139,3cyclictest13141-21tr07:15:151
1007899139,3cyclictest11985-21cat11:49:591
1007899132,3cyclictest0-21swapper/109:30:131
1007899131,1cyclictest21850-21taskset07:31:201
10078991310,2cyclictest7177-21cut10:10:141
10078991310,2cyclictest6976-21ssh12:05:271
10078991310,2cyclictest29966-21sed08:55:281
10078991310,2cyclictest22641-21tr07:35:151
10078991310,2cyclictest17951-21tr07:25:171
1007899130,13cyclictest0-21swapper/110:58:011
1007899130,11cyclictest9320-21sed10:30:211
1007599139,3cyclictest20924-21cut11:55:140
1007599131,7cyclictest10980-21munin-run11:30:000
1008499129,2cyclictest4694-21cat12:05:013
1008499129,2cyclictest4694-21cat12:05:003
1008499129,2cyclictest21698-21grep07:30:273
1008499129,2cyclictest19282-21grep07:25:293
1008499129,2cyclictest17271-21sed10:15:263
1008499129,2cyclictest16972-21grep08:30:203
1008499129,2cyclictest11562-21sed11:10:213
1008499129,2cyclictest10674-21chrt09:33:323
1008499128,3cyclictest5923-21ssh11:26:033
1008499128,3cyclictest14019-21grep09:15:273
1008499128,2cyclictest9363-21grep08:15:163
1008499128,2cyclictest16053-21sed07:20:183
1008499120,12cyclictest0-21swapper/311:01:203
1008199129,2cyclictest9796-21grep08:15:182
1008199129,2cyclictest4509-21ls11:25:212
1008199129,2cyclictest30450-21awk09:00:012
1008199129,2cyclictest27184-21grep08:50:222
1008199129,2cyclictest25312-21grep08:45:282
1008199129,2cyclictest25312-21grep08:45:282
1008199129,2cyclictest17004-21cut08:30:202
1008199129,2cyclictest11036-21head07:10:172
1008199120,12cyclictest0-21swapper/209:47:012
1008199120,11cyclictest31486-21sh10:24:592
1008199120,11cyclictest29993-21wc09:25:222
1008199120,11cyclictest26320-21wc07:40:272
1007899129,2cyclictest4575-21tr08:05:171
1007899129,2cyclictest3575-21grep08:00:271
1007899129,2cyclictest30074-21grep11:40:271
1007899129,2cyclictest28288-21ssh11:20:211
1007899129,2cyclictest26565-21grep08:50:171
1007899129,2cyclictest16047-21cat09:55:261
1007899128,3cyclictest6677-21head09:50:181
1007899128,3cyclictest17604-21ssh09:18:101
1007899124,4cyclictest0-21swapper/109:46:221
1007899121,2cyclictest0-21swapper/109:23:061
1007899120,11cyclictest26056-21cut11:00:121
1007599129,2cyclictest5879-21grep12:05:170
1007599129,2cyclictest5409-21ssh11:45:190
1007599129,2cyclictest32163-21grep07:55:160
1007599129,2cyclictest27557-21grep11:20:150
1007599129,2cyclictest25563-21sed07:40:180
1007599129,2cyclictest20718-21sort07:30:180
1007599129,2cyclictest19600-21grep08:35:180
1007599129,2cyclictest19509-21ssh10:36:250
1007599129,2cyclictest16239-21tail10:15:170
1007599129,2cyclictest14830-21ssh09:55:150
1007599129,2cyclictest13722-21grep11:50:200
1007599129,2cyclictest11041-21grep10:50:270
1007599127,5cyclictest3487-21apache211:31:320
1007599127,5cyclictest3487-21apache209:43:370
1007599121,7cyclictest225-21systemd-journal08:10:000
10075991211,1cyclictest0-21swapper/012:39:530
10075991210,1cyclictest0-21swapper/012:30:110
1007599120,4cyclictest0-21swapper/010:55:550
1007599120,11cyclictest30701-21head09:45:160
1007599120,0cyclictest0-21swapper/012:11:430
1008499118,2cyclictest7937-21grep08:10:243
1008499118,2cyclictest29656-21grep07:50:143
1008499118,2cyclictest29279-21cron07:50:003
1008499118,2cyclictest2926-21ssh10:07:233
1008499118,2cyclictest25965-21seq12:36:253
1008499118,2cyclictest23918-21ssh11:18:023
1008499118,2cyclictest1921-21cut08:00:143
1008499118,2cyclictest18770-21ssh09:57:263
1008499118,2cyclictest13555-21seq12:10:133
1008499118,2cyclictest11776-21tr08:20:163
1008499117,3cyclictest30204-21cut09:45:133
1008499110,9cyclictest23016-21python09:40:253
1008499110,10cyclictest30923-21tail12:20:163
1008499110,10cyclictest30426-21ssh11:40:393
1008499110,10cyclictest11366-21ssh10:50:393
1008199118,2cyclictest7731-21ssh09:31:142
1008199118,2cyclictest21764-21sh09:20:212
1008199118,2cyclictest18301-21grep07:25:192
1008199118,2cyclictest14789-21ssh09:15:572
1008199118,2cyclictest12224-21grep08:20:182
1008199112,2cyclictest225-21systemd-journal08:03:382
1007899119,1cyclictest14090-21ssh09:35:191
1007899118,2cyclictest3509-21test09:10:011
1007899118,2cyclictest21156-21seq11:55:141
1007899118,2cyclictest17390-21cron07:25:001
1007899117,3cyclictest22114-21grep09:40:171
1007899111,9cyclictest0-21swapper/111:15:131
1007899111,8cyclictest25702-21idleruntime-cro08:50:001
1007899111,8cyclictest25702-21idleruntime-cro08:50:001
1007899111,3cyclictest0-21swapper/107:45:241
1007599119,1cyclictest24508-21ssh10:20:160
1007599118,2cyclictest8904-21ssh10:30:180
1007599118,2cyclictest5327-21rm09:30:150
1007599118,2cyclictest5326-21ssh12:24:490
1007599118,2cyclictest438-21rm11:04:160
1007599118,2cyclictest3823-21sed11:05:260
1007599118,2cyclictest3213-21rm10:26:430
1007599118,2cyclictest30503-21ls09:00:010
1007599118,2cyclictest27294-21ssh10:41:000
1007599118,2cyclictest25692-21cron08:50:000
1007599118,2cyclictest25692-21cron08:50:000
1007599118,2cyclictest16641-21ssh09:36:430
1007599118,2cyclictest13642-21grep07:15:180
1007599118,2cyclictest12604-21cut08:20:210
1007599118,2cyclictest11689-21sh09:53:260
1007599110,10cyclictest22597-21ssh11:36:020
1008499107,2cyclictest409-21cut07:55:203
1008499107,2cyclictest13537-21cut07:15:183
1008199108,1cyclictest8278-21cat08:10:282
1008199108,1cyclictest3059-21sed09:10:012
1008199108,1cyclictest292322sleep207:49:252
1007899108,2cyclictest4752-21ssh11:25:241
1007899108,1cyclictest9922-21cat08:15:191
1007899108,1cyclictest18967-21egrep08:35:151
1007899108,1cyclictest14092-21cut08:25:171
1007899107,2cyclictest18351-21apt-get08:34:591
1007899107,2cyclictest11440-21ntpq07:10:211
1007899107,2cyclictest10202-21ssh11:10:081
1007899100,9cyclictest32124-21sensors09:00:231
1007899100,9cyclictest26675-21ssh10:40:301
1007599108,1cyclictest30040-21sed07:50:150
1007599108,1cyclictest27537-21cat07:45:170
1007599108,1cyclictest26240-21cut08:50:140
1007599108,1cyclictest17633-21chrt07:25:110
1007599107,2cyclictest1225-21expr09:05:150
1007599100,9cyclictest2265-21expr08:00:150
1007599100,4cyclictest0-21swapper/011:15:130
100849996,2cyclictest25583-21grep07:40:183
100789998,1cyclictest2887-21sshd09:08:331
100759997,1cyclictest9073-21cat08:15:120
100759997,1cyclictest22433-21aten2_r7power_c07:35:140
100759996,2cyclictest31058-21expr09:00:150
100759996,2cyclictest14580-21grep08:25:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional