You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 10:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Tue Jun 30, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1319821010,1sleep30-21swapper/323:37:153
789499987,59cyclictest0-21swapper/022:10:230
789499987,59cyclictest0-21swapper/022:10:230
789499897,75cyclictest0-21swapper/022:15:230
169802870,3sleep1221ktimersoftd/100:20:371
63942840,7sleep36398-21fschecks_time19:05:273
317812780,8sleep0789499cyclictest00:00:190
269682750,2sleep10-21swapper/122:35:331
326842740,2sleep20-21swapper/222:42:302
789499721,38cyclictest0-21swapper/020:55:220
7894997111,46cyclictest0-21swapper/023:25:310
229462690,2sleep30-21swapper/321:14:593
7894996818,37cyclictest7339-21idleruntime-cro00:10:100
7894996818,37cyclictest7339-21idleruntime-cro00:10:100
789499641,8cyclictest23162-21apt-config23:50:100
789499641,4cyclictest2715-21ls22:45:300
789599636,26cyclictest0-21swapper/122:15:231
7895996321,11cyclictest7950irq/56-dwc_otg_23:20:211
789499632,28cyclictest15653-21sed23:00:380
789499624,35cyclictest0-21swapper/019:40:220
7894996218,34cyclictest727-21runrttasks21:53:200
789499611,38cyclictest14141-21grep22:20:260
302552610,5sleep1789599cyclictest21:22:501
789499608,30cyclictest11921-21aten_rbpower_vo00:15:220
789499604,33cyclictest0-21swapper/023:55:220
7894996029,5cyclictest7850irq/56-dwc_otg00:25:100
789499599,5cyclictest0-21swapper/019:10:280
789499596,25cyclictest0-21swapper/020:30:230
789499593,49cyclictest12906-21ls21:40:310
789499586,9cyclictest0-21swapper/022:05:220
7894995832,4cyclictest8050irq/56-dwc_otg_21:30:300
789499581,5cyclictest28641-21tr00:35:250
291042580,3sleep1221ktimersoftd/100:35:311
789499572,30cyclictest0-21swapper/020:05:210
7894995721,10cyclictest31258-21chrt23:20:250
789499571,6cyclictest9281-21unixbench_multi20:40:390
789499571,10cyclictest16719-21apt19:35:100
789499561,33cyclictest23692-21fschecks_count21:15:280
7894995612,5cyclictest9550irq/48-DMA15:26:470
16492560,2sleep10-21swapper/120:20:341
16492560,2sleep10-21swapper/120:20:341
789699557,23cyclictest0-21swapper/220:10:232
7894995531,5cyclictest7950irq/56-dwc_otg_23:40:270
7894995511,26cyclictest32331-21cut21:25:290
789499546,5cyclictest0-21swapper/000:30:240
789499545,11cyclictest7950irq/56-dwc_otg_23:15:240
789499543,26cyclictest0-21swapper/021:55:230
7894995428,6cyclictest7950irq/56-dwc_otg_19:25:280
789499541,8cyclictest11001-21grep22:55:310
789499541,7cyclictest10871-21unixbench_singl19:15:410
789599531,5cyclictest4737-21ls20:30:251
789499536,22cyclictest0-21swapper/021:40:100
789499536,22cyclictest0-21swapper/021:40:100
7894995317,19cyclictest22811-21netstat22:30:320
789499531,30cyclictest0-21swapper/021:10:280
789499531,28cyclictest17529-21fschecks_time21:05:280
42382530,2sleep30-21swapper/323:26:003
789499522,33cyclictest7249-21switchtime20:35:360
789499521,46cyclictest26206-21wget20:00:250
789499521,26cyclictest28059-21cut21:20:280
789499521,25cyclictest17339-21missed_timers21:45:320
789499521,24cyclictest23850-21grep23:50:270
789499512,3cyclictest0-21swapper/022:02:500
789499512,30cyclictest0-21swapper/021:00:270
789499512,27cyclictest6346-21ssh22:50:260
789499511,4cyclictest2835-21aten_rbpower_en20:25:250
7894995112,15cyclictest0-21swapper/019:45:200
789799502,7cyclictest8050irq/56-dwc_otg_20:10:223
789499502,17cyclictest0-21swapper/020:15:100
789499501,8cyclictest0-21swapper/019:55:220
789499501,30cyclictest8076-21fschecks_time00:10:310
789599493,2cyclictest0-21swapper/123:45:351
789499498,38cyclictest0-21swapper/023:10:370
7894994929,3cyclictest0-21swapper/023:35:380
7894994922,7cyclictest16527-21kworker/0:019:40:100
7895994834,10cyclictest8050irq/56-dwc_otg_22:30:211
789499488,26cyclictest0-21swapper/022:25:250
7894994828,4cyclictest7950irq/56-dwc_otg_00:25:260
7894994822,12cyclictest727-21runrttasks22:42:010
789599477,24cyclictest17975-21ssh22:25:251
789599476,21cyclictest0-21swapper/121:40:231
7894994711,5cyclictest7950irq/56-dwc_otg_20:50:230
7894994710,19cyclictest0-21swapper/023:34:550
245902470,5sleep27950irq/56-dwc_otg_23:11:372
99362460,2sleep30-21swapper/321:36:373
99362460,2sleep30-21swapper/321:36:373
789799467,25cyclictest0-21swapper/319:45:153
789699467,25cyclictest0-21swapper/220:50:252
7896994619,5cyclictest7850irq/56-dwc_otg22:15:212
789599467,25cyclictest0-21swapper/119:15:241
789599466,28cyclictest13811-21ssh22:20:221
789499461,20cyclictest12686-21chrt19:20:400
7895994521,12cyclictest20558-21latency_hist19:45:101
789599451,40cyclictest3217750ssh21:25:261
7894994521,5cyclictest11077-21grep20:45:370
73812452,13sleep00-21swapper/019:07:030
789799441,9cyclictest61-21kswapd022:15:213
789699447,22cyclictest0-21swapper/219:45:152
789599449,5cyclictest0-21swapper/100:15:191
789599441,6cyclictest7950irq/56-dwc_otg_00:05:281
789599441,6cyclictest7950irq/56-dwc_otg_00:05:281
7895994410,23cyclictest7850irq/56-dwc_otg20:40:391
7894994416,12cyclictest0-21swapper/022:36:470
789699437,25cyclictest0-21swapper/221:20:242
7896994317,6cyclictest30101-21missed_timers22:00:322
789599437,24cyclictest14480-21ssh23:00:231
789599437,22cyclictest0-21swapper/100:00:221
789599433,9cyclictest0-21swapper/120:15:201
789499439,4cyclictest23757-21vmstat19:50:380
7894994312,14cyclictest32600-21timerwakeupswit20:15:350
789799427,23cyclictest0-21swapper/319:40:163
7896994219,12cyclictest3877-21grep20:25:392
7896994211,6cyclictest7950irq/56-dwc_otg_00:20:112
789599422,4cyclictest750-21snmpd19:55:221
789599421,4cyclictest0-21swapper/100:28:001
789599421,22cyclictest0-21swapper/121:05:211
46982420,2sleep20-21swapper/221:30:362
789699417,7cyclictest0-21swapper/223:55:102
789599413,11cyclictest23424-21ssh21:15:241
7895994122,8cyclictest30110-21ssh23:57:421
789599411,25cyclictest17271-21cat21:45:311
7897994029,4cyclictest7950irq/56-dwc_otg_21:45:103
7897994020,10cyclictest23104-21idleruntime-cro23:50:103
789699403,14cyclictest8050irq/56-dwc_otg_19:35:252
789699401,5cyclictest29-21rcuc/223:45:102
789699401,3cyclictest0-21swapper/200:10:272
7896994013,14cyclictest10863-21awk19:15:412
789599406,22cyclictest7850irq/56-dwc_otg21:50:321
789599404,29cyclictest7850irq/56-dwc_otg23:15:311
789599402,4cyclictest7850irq/56-dwc_otg19:10:231
789599402,21cyclictest0-21swapper/122:51:511
7895994010,21cyclictest13688-21aten_rbpower_po20:55:251
789799394,23cyclictest0-21swapper/322:00:243
789699397,13cyclictest8050irq/56-dwc_otg_19:45:102
789699395,18cyclictest8050irq/56-dwc_otg_20:20:262
789699395,18cyclictest8050irq/56-dwc_otg_20:20:262
789699391,20cyclictest0-21swapper/220:45:202
7896993911,7cyclictest18271-21grep21:05:382
7895993919,6cyclictest2448250wget00:30:251
789799385,5cyclictest7444-21unixbench_multi22:50:413
789799381,22cyclictest10152-21cpuspeed20:45:243
7896993816,4cyclictest31-21ksoftirqd/221:35:392
7896993816,4cyclictest31-21ksoftirqd/221:35:392
789599389,5cyclictest722-21kworker/1:123:25:221
789599389,16cyclictest8078-21grep23:30:371
789599383,23cyclictest8050irq/56-dwc_otg_20:10:201
789599382,24cyclictest7850irq/56-dwc_otg22:10:381
789599382,24cyclictest7850irq/56-dwc_otg22:10:381
789599381,28cyclictest13360-21latency_hist20:55:111
7894993818,9cyclictest0-21swapper/020:22:370
7894993818,9cyclictest0-21swapper/020:22:370
89402370,4sleep3381ktimersoftd/323:32:003
7897993719,7cyclictest4096-21fschecks_count21:30:273
789699377,23cyclictest0-21swapper/219:10:252
789699373,5cyclictest0-21swapper/223:59:262
789699372,11cyclictest0-21swapper/219:20:302
789599372,27cyclictest7850irq/56-dwc_otg21:14:541
7895993715,14cyclictest26379-21grep21:55:391
789599371,27cyclictest7850irq/56-dwc_otg22:08:581
789599371,23cyclictest7850irq/56-dwc_otg19:35:111
789799361,5cyclictest16424-21grep23:40:383
789799361,4cyclictest7684-21ssh00:10:243
789799361,24cyclictest23691-21grep21:15:283
789799361,23cyclictest23112-21uniq23:10:273
7897993610,16cyclictest37-21rcuc/321:58:203
789699368,21cyclictest29965-1kworker/2:1H21:45:212
7896993618,4cyclictest16215-21/usr/sbin/munin21:00:362
789699361,7cyclictest2741850ssh23:15:312
7896993617,5cyclictest12849-21sh23:36:362
789599367,25cyclictest0-21swapper/119:35:241
789599367,22cyclictest0-21swapper/123:50:231
789599366,5cyclictest0-21swapper/120:05:231
789599365,23cyclictest7850irq/56-dwc_otg20:35:341
789599362,22cyclictest0-21swapper/122:41:301
789599361,8cyclictest30300-21ps22:00:351
7895993615,4cyclictest18780-21diskmemload23:05:271
789599361,4cyclictest8050irq/56-dwc_otg_19:20:221
7895993610,17cyclictest7850irq/56-dwc_otg23:40:251
7895993610,14cyclictest3100-21fschecks_time20:25:291
216852360,10sleep2301ktimersoftd/223:47:372
164872360,2sleep20-21swapper/223:01:552
789799358,16cyclictest0-21swapper/323:09:563
789799355,23cyclictest0-21swapper/322:32:493
7897993512,8cyclictest18780-21diskmemload23:21:243
789699359,5cyclictest7850irq/56-dwc_otg21:25:412
789699359,4cyclictest7950irq/56-dwc_otg_22:55:112
789699355,5cyclictest26267-21basename22:35:242
789699355,4cyclictest7950irq/56-dwc_otg_20:40:252
789699352,16cyclictest2592150ssh00:31:062
7896993516,9cyclictest20369-21ssh23:06:262
789699351,25cyclictest22834-21cut19:50:272
789599354,22cyclictest0-21swapper/100:10:371
789599352,5cyclictest0-21swapper/121:33:481
7895993518,5cyclictest8360-21fschecks_count21:35:271
7895993518,5cyclictest8360-21fschecks_count21:35:271
789599351,21cyclictest11556-21latency_hist20:50:111
247322350,1sleep20-21swapper/219:55:282
789799349,4cyclictest0-21swapper/300:26:383
789799347,13cyclictest8050irq/56-dwc_otg_23:05:103
789799344,4cyclictest32082-21fschecks_count00:00:253
789799342,8cyclictest0-21swapper/323:52:073
789799342,5cyclictest37-21rcuc/319:31:243
789699349,5cyclictest7850irq/56-dwc_otg21:10:392
789699348,4cyclictest0-21swapper/200:25:252
789699343,6cyclictest7950irq/56-dwc_otg_23:25:102
7896993421,8cyclictest28506-21ssh00:35:232
789699341,7cyclictest23279-21ssh21:52:252
7896993417,5cyclictest4269-21sh22:08:342
7896993414,5cyclictest24335-21/usr/sbin/munin21:15:372
7896993413,5cyclictest2958-21/usr/sbin/munin22:45:342
789599343,3cyclictest7950irq/56-dwc_otg_22:48:151
789599342,8cyclictest0-21swapper/120:02:411
7895993412,15cyclictest10326-21ssh22:55:211
789799335,5cyclictest7950irq/56-dwc_otg_00:20:103
789799335,5cyclictest4330-21idleruntime-cro20:30:093
789799333,23cyclictest8050irq/56-dwc_otg_19:10:233
789699338,6cyclictest0-21swapper/221:40:252
789699335,14cyclictest8050irq/56-dwc_otg_23:34:552
7896993313,4cyclictest7950irq/56-dwc_otg_22:30:332
7896993313,4cyclictest10457-21wget22:55:242
7896993311,6cyclictest0-21swapper/200:00:342
7896993310,13cyclictest727-21runrttasks23:28:342
789599333,5cyclictest0-21swapper/119:25:261
789599332,22cyclictest7850irq/56-dwc_otg19:55:101
244342331,4sleep118780-21diskmemload23:11:211
789799327,19cyclictest0-21swapper/321:29:193
789799325,18cyclictest0-21swapper/322:05:313
789799324,3cyclictest0-21swapper/322:25:283
789799323,17cyclictest11-21rcu_preempt19:25:393
7897993216,5cyclictest21581-21/usr/sbin/munin21:50:313
7897993215,4cyclictest28937-21unixbench_singl21:20:393
789799321,4cyclictest26208-21apt-get22:35:233
7897993214,9cyclictest30954-21ssh00:37:453
789699329,12cyclictest0-21swapper/200:20:242
789699324,4cyclictest18242-21fschecks_count22:25:282
789699322,6cyclictest0-21swapper/222:23:502
7896993215,6cyclictest709350ssh22:11:072
7896993215,6cyclictest709350ssh22:11:072
7896993211,4cyclictest6291-21date20:35:102
789599328,12cyclictest0-21swapper/123:39:121
789599324,18cyclictest7850irq/56-dwc_otg19:45:301
68162325,16sleep26896-21/usr/sbin/munin19:05:352
789799319,6cyclictest22807-1kworker/u9:022:10:313
789799319,6cyclictest22807-1kworker/u9:022:10:313
789799312,18cyclictest2445-21ls22:45:273
789799311,5cyclictest0-21swapper/320:05:283
789799311,4cyclictest8050irq/56-dwc_otg_23:55:373
789799311,4cyclictest13795-21apt-get22:20:213
789699317,6cyclictest7950irq/56-dwc_otg_00:09:192
789699317,6cyclictest7950irq/56-dwc_otg_00:09:192
7896993116,4cyclictest28444-21kernelversion20:05:302
789699311,14cyclictest8050irq/56-dwc_otg_20:00:402
7896993111,11cyclictest0-21swapper/221:55:392
7896993111,11cyclictest0-21swapper/219:25:382
789799308,20cyclictest0-21swapper/320:20:263
789799308,20cyclictest0-21swapper/320:20:263
789799306,14cyclictest0-21swapper/320:50:253
789799303,3cyclictest0-21swapper/322:55:373
789799302,7cyclictest24664-21fschecks_time19:55:273
789799301,6cyclictest31865-21fschecks_count20:15:253
7897993014,5cyclictest11799-21grep19:20:283
789799301,3cyclictest0-21swapper/300:20:533
7897993012,4cyclictest18623-21seq21:08:233
789799301,19cyclictest25458-21ssh00:30:393
789799301,18cyclictest0-21swapper/300:10:113
789799301,18cyclictest0-21swapper/300:10:113
7896993011,13cyclictest163502chrt19:30:482
789599302,8cyclictest0-21swapper/121:00:261
789799298,9cyclictest0-21swapper/321:47:323
789799291,5cyclictest10830-21grep19:15:403
789799291,22cyclictest26434-21cut20:00:283
7896992911,5cyclictest31793-21df20:15:232
789799283,6cyclictest7950irq/56-dwc_otg_20:45:103
789799281,8cyclictest0-21swapper/319:39:583
789799281,6cyclictest0-21swapper/323:15:303
789799281,5cyclictest0-21swapper/319:50:243
7897992813,9cyclictest18780-21diskmemload22:40:513
7897992811,10cyclictest125-21systemd-journal20:31:483
7896992811,4cyclictest301ktimersoftd/220:55:322
789799276,14cyclictest8050irq/56-dwc_otg_20:35:343
789699276,11cyclictest8050irq/56-dwc_otg_20:35:282
789799261,5cyclictest8050irq/56-dwc_otg_20:55:393
789799261,18cyclictest0-21swapper/321:01:013
70642264,12sleep10-21swapper/119:05:381
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional