You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 14:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Sat Sep 12, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31954991354,113cyclictest0-21swapper/021:20:400
31954991215,94cyclictest0-21swapper/021:25:460
319549910965,13cyclictest7850irq/56-dwc_otg_22:10:300
319549910633,37cyclictest0-21swapper/020:25:330
319559910437,41cyclictest23945-21ssh21:25:471
31954991025,8cyclictest7950irq/56-dwc_otg_21:10:320
31955999534,35cyclictest0-21swapper/121:20:391
31954999031,36cyclictest0-21swapper/020:30:300
3195499898,14cyclictest0-21swapper/023:05:310
3195499866,61cyclictest0-21swapper/021:00:320
3195499857,24cyclictest0-21swapper/023:45:350
3195499844,28cyclictest0-21swapper/023:35:410
31955998334,25cyclictest7750irq/56-dwc_otg21:10:321
3195499822,22cyclictest0-21swapper/022:00:390
31954997918,39cyclictest13-21rcuc/020:00:310
74582780,2sleep30-21swapper/321:45:383
217812780,2sleep30-21swapper/322:02:253
91762750,2sleep20-21swapper/200:25:202
3195599742,9cyclictest7750irq/56-dwc_otg21:00:311
31955997133,19cyclictest5226-21/usr/sbin/munin20:55:491
31955997133,13cyclictest593-21ssh23:35:291
25992710,2sleep20-21swapper/221:40:092
3195699702,29cyclictest29-21rcuc/221:25:482
31956997016,33cyclictest7950irq/56-dwc_otg_21:20:402
3195499701,39cyclictest0-21swapper/021:50:390
31955996923,27cyclictest4804-21run-parts00:20:091
3195599692,10cyclictest0-21swapper/119:25:311
31955996833,20cyclictest3617-21/usr/sbin/munin22:20:461
31955996829,24cyclictest12325-21ssh23:49:471
3195499681,38cyclictest0-21swapper/023:32:280
31955996728,13cyclictest31361-21ssh22:53:521
31955996727,11cyclictest9930-21sed00:25:391
31955996727,11cyclictest9930-21sed00:25:391
303242660,2sleep30-21swapper/320:35:213
31957996544,16cyclictest7950irq/56-dwc_otg_23:30:303
31955996530,18cyclictest874-21ssh21:37:001
31955996528,23cyclictest31309-21rm22:14:491
31955996528,12cyclictest7750irq/56-dwc_otg22:40:311
31955996528,12cyclictest11206-21ssh21:50:271
31955996426,19cyclictest7750irq/56-dwc_otg23:55:261
31955996327,20cyclictest19677-21ssh00:37:151
31955996327,15cyclictest21672-21if_wlan000:00:381
31955996327,15cyclictest21672-21if_wlan000:00:381
31955996326,24cyclictest26860-21ssh23:27:081
31955996325,18cyclictest8194-21ssh23:05:231
31955996323,15cyclictest16726-21cron23:55:191
31954996317,10cyclictest0-21swapper/019:35:330
31955996227,18cyclictest16773-21ssh00:34:281
31955996225,13cyclictest31288-21ssh23:32:431
31955996223,15cyclictest17636-21wget20:00:331
31955996221,16cyclictest31943-21sh22:15:311
31955996216,21cyclictest7750irq/56-dwc_otg20:20:191
3195499621,31cyclictest18836-21latency_hist21:20:200
3195499621,31cyclictest18836-21latency_hist21:20:200
31955996133,11cyclictest7747-21sed19:30:461
31955996131,8cyclictest24125-21ssh23:24:421
31955996127,17cyclictest6256-21ssh23:02:131
31955996127,12cyclictest9661-21ssh21:48:011
31955996122,15cyclictest7702-21ssh23:43:501
3195499616,22cyclictest0-21swapper/020:55:260
3195599604,16cyclictest7850irq/56-dwc_otg_21:55:321
31955996027,21cyclictest10338-21run-parts21:09:311
31955996026,18cyclictest26917-21ssh22:48:211
31955996026,18cyclictest26917-21ssh22:48:211
31955996021,23cyclictest25881-21ssh22:07:231
3195499606,51cyclictest0-21swapper/022:50:310
31954996010,28cyclictest32220-21proc_pri21:35:450
31955995935,11cyclictest5188-21ssh00:20:271
31955995931,11cyclictest15300-21ssh23:13:381
31955995926,24cyclictest18058-21ssh23:16:071
31957995821,22cyclictest381ktimersoftd/321:25:463
31955995822,16cyclictest3498-21ssh22:59:431
31955995821,11cyclictest0-21swapper/122:26:351
31954995828,15cyclictest7950irq/56-dwc_otg_23:55:470
31954995810,36cyclictest0-21swapper/021:45:440
31955995727,11cyclictest13925-21ssh22:32:101
31954995736,6cyclictest9039-21idleruntime-cro00:25:200
3195499572,33cyclictest0-21swapper/020:40:190
3195499571,36cyclictest14176-21netstat00:30:400
3195699563,33cyclictest0-21swapper/221:10:332
31955995628,13cyclictest26626-21/usr/sbin/munin20:25:411
31955995621,22cyclictest18627-21ssh21:20:141
31955995621,22cyclictest18627-21ssh21:20:141
31955995621,12cyclictest19464-21find22:00:211
31955995620,14cyclictest20865-21chrt20:09:111
31954995628,5cyclictest7750irq/56-dwc_otg19:15:470
3195499561,15cyclictest0-21swapper/022:35:450
130412560,2sleep20-21swapper/200:30:112
130412560,2sleep20-21swapper/200:30:112
3195599556,8cyclictest7950irq/56-dwc_otg_20:20:311
31955995529,11cyclictest27015-21ssh00:06:321
31955995526,15cyclictest29567-21unixbench_multi20:30:461
31955995524,18cyclictest28799-21ssh21:31:151
31955995522,11cyclictest7950irq/56-dwc_otg_19:25:191
31955995521,23cyclictest5295-21seq21:42:331
31955995521,23cyclictest5295-21seq21:42:331
35452540,2sleep00-21swapper/019:20:400
31955995427,12cyclictest18087-21ssh22:37:161
3195599542,13cyclictest0-21swapper/119:50:291
31955995420,20cyclictest7750irq/56-dwc_otg20:50:461
31955995420,20cyclictest7750irq/56-dwc_otg20:50:461
31955995420,20cyclictest13675-21seq19:49:341
31955995420,20cyclictest13675-21seq19:49:341
31955995418,15cyclictest32740-21sh00:14:281
31955995418,14cyclictest22684-21chrt20:14:221
31954995426,3cyclictest0-21swapper/022:30:200
31954995423,9cyclictest4497-21unixbench_singl20:50:460
31954995423,9cyclictest4497-21unixbench_singl20:50:460
3195499541,50cyclictest0-21swapper/000:00:470
3195499541,50cyclictest0-21swapper/000:00:470
41912530,2sleep20-21swapper/221:40:462
41912530,2sleep20-21swapper/221:40:462
31956995310,35cyclictest0-21swapper/221:00:312
3195499532,8cyclictest0-21swapper/023:15:390
31954995328,13cyclictest0-21swapper/000:20:120
3195499531,28cyclictest25431-21unixbench_multi22:45:470
3195499531,28cyclictest25431-21unixbench_multi22:45:470
31955995224,18cyclictest31582-21sshd20:36:191
31954995236,6cyclictest18868-21grep00:35:490
3195799512,29cyclictest381ktimersoftd/321:20:413
3195699514,9cyclictest0-21swapper/220:20:312
31955995123,8cyclictest15799-21apt-get19:55:311
31955995120,14cyclictest7850irq/56-dwc_otg_20:50:071
3195499513,29cyclictest0-21swapper/022:20:480
3195499512,23cyclictest0-21swapper/023:25:410
3195799507,6cyclictest0-21swapper/320:40:303
31955995016,13cyclictest327-21ls20:40:401
31954995024,4cyclictest5076-21sshd23:00:440
31954995021,18cyclictest30306-21kworker/0:123:40:310
31954995016,14cyclictest775-21grep22:15:470
3195499501,5cyclictest827-21ntp_states22:55:430
3195499501,28cyclictest6895-21tr19:30:340
3195499501,28cyclictest0-21swapper/020:10:440
3195499501,23cyclictest13068-21latency23:10:410
3195799495,22cyclictest7950irq/56-dwc_otg_21:10:333
3195499497,32cyclictest25310-21ssh00:05:320
3195499493,28cyclictest0-21swapper/022:10:200
3195499491,45cyclictest0-21swapper/020:05:450
3195499491,3cyclictest0-21swapper/023:50:280
3195499491,25cyclictest24596-21munin-plugin-st20:20:190
3195799486,5cyclictest7950irq/56-dwc_otg_22:25:313
31955994821,12cyclictest985-21taskset19:14:161
3195499487,31cyclictest0-21swapper/021:40:320
3195499487,31cyclictest0-21swapper/021:40:320
31954994823,7cyclictest15564-21munin-plugin-st19:55:190
31954994815,4cyclictest9-21ksoftirqd/021:05:310
31954994813,14cyclictest0-21swapper/020:40:300
315072483,12sleep00-21swapper/019:08:080
31956994714,26cyclictest0-21swapper/219:25:312
3195599474,25cyclictest0-21swapper/119:35:331
31955994719,10cyclictest0-21swapper/119:40:351
3195499479,20cyclictest0-21swapper/022:45:200
31954994733,5cyclictest0-21swapper/022:30:450
3195499473,23cyclictest0-21swapper/021:55:320
31954994721,15cyclictest0-21swapper/021:33:350
31954994720,23cyclictest0-21swapper/023:20:410
3195499471,24cyclictest11012-21ssh00:26:260
3195499471,24cyclictest11012-21ssh00:26:260
3195499471,20cyclictest17354-21modprobe20:00:190
3195699467,26cyclictest0-21swapper/219:50:312
3195699467,25cyclictest0-21swapper/223:35:322
3195699465,9cyclictest0-21swapper/222:45:322
3195699465,9cyclictest0-21swapper/222:45:322
31955994616,14cyclictest2643-21chrt19:17:061
3195499461,5cyclictest2656-21sed20:45:470
3195499461,24cyclictest25136-21fschecks_time20:20:370
3195499461,23cyclictest5353-21/usr/sbin/munin19:25:370
3195499461,15cyclictest11401-21timerwakeupswit19:40:470
3195799457,23cyclictest0-21swapper/319:15:333
3195499452,27cyclictest0-21swapper/019:50:200
3195499452,27cyclictest0-21swapper/019:50:200
3195799446,21cyclictest7950irq/56-dwc_otg_23:10:203
239222441,37sleep20-21swapper/220:15:452
3195799436,25cyclictest0-21swapper/320:50:323
3195799436,25cyclictest0-21swapper/320:50:323
3195799431,6cyclictest0-21swapper/319:20:333
3195699431,2cyclictest0-21swapper/223:30:302
3195499432,6cyclictest0-21swapper/000:10:470
3195799429,16cyclictest0-21swapper/321:40:323
3195799429,16cyclictest0-21swapper/321:40:323
3195799412,6cyclictest7950irq/56-dwc_otg_00:20:313
3195699413,3cyclictest7750irq/56-dwc_otg22:30:312
3195499411,21cyclictest944-21sshd19:13:440
3195799405,16cyclictest7850irq/56-dwc_otg_22:20:363
31957994028,8cyclictest0-21swapper/320:15:463
31957994013,17cyclictest32605-21aten_rbpower_po22:55:343
3195699402,9cyclictest0-21swapper/222:10:322
31956994016,5cyclictest31-21ksoftirqd/221:50:392
113972400,3sleep2301ktimersoftd/223:48:042
3195699394,6cyclictest7850irq/56-dwc_otg_21:15:332
3195699394,6cyclictest7850irq/56-dwc_otg_21:15:332
3195799386,8cyclictest7950irq/56-dwc_otg_23:15:203
3195799386,11cyclictest7950irq/56-dwc_otg_23:20:193
3195699382,4cyclictest7950irq/56-dwc_otg_22:15:302
31956993816,6cyclictest31-21ksoftirqd/219:30:342
31956993719,5cyclictest28732-21sh00:09:422
3195799367,21cyclictest0-21swapper/319:30:333
3195799364,20cyclictest13580-21aten_rbpower_vo00:30:323
3195799361,19cyclictest5135-21ls19:25:343
3195699367,25cyclictest0-21swapper/220:35:252
3195699366,5cyclictest31-21ksoftirqd/220:00:342
3195699363,5cyclictest1180-21runrttasks20:05:312
31956993619,7cyclictest29-21rcuc/219:11:272
31956993616,8cyclictest31-21ksoftirqd/220:55:202
31956993616,8cyclictest31-21ksoftirqd/220:55:202
31956993613,4cyclictest17025-21if_eth023:15:382
271222360,1sleep30-21swapper/322:09:413
235322360,4sleep231-21ksoftirqd/223:23:362
99972351,4sleep20-21swapper/222:27:332
3195799358,6cyclictest15648-21apt22:35:193
31957993514,11cyclictest1180-21runrttasks23:40:193
3195699357,7cyclictest31-21ksoftirqd/222:20:402
3195699357,24cyclictest0-21swapper/219:45:322
3195699357,24cyclictest0-21swapper/219:45:322
3195699353,19cyclictest7850irq/56-dwc_otg_20:25:402
3195699352,19cyclictest7850irq/56-dwc_otg_22:00:192
3195699351,21cyclictest8059-21ssh23:05:202
31956993510,5cyclictest7750irq/56-dwc_otg21:30:462
191802350,3sleep30-21swapper/322:00:193
7962340,2sleep2786-21ssh22:55:422
3195799347,6cyclictest7750irq/56-dwc_otg21:50:483
3195799347,23cyclictest0-21swapper/319:55:333
3195799347,15cyclictest0-21swapper/300:10:323
3195799346,15cyclictest0-21swapper/319:35:333
3195799346,13cyclictest7950irq/56-dwc_otg_21:00:473
31957993420,11cyclictest7950irq/56-dwc_otg_22:15:363
31957993415,5cyclictest28367-21sh00:09:013
3195799341,20cyclictest29430-21timerwakeupswit20:30:453
31957993411,3cyclictest0-21swapper/300:25:353
31957993411,3cyclictest0-21swapper/300:25:353
3195799341,11cyclictest12224-21wget19:45:323
3195799341,11cyclictest12224-21wget19:45:323
31957993410,5cyclictest7950irq/56-dwc_otg_20:15:193
31957993410,12cyclictest0-21swapper/323:00:423
3195699347,5cyclictest7850irq/56-dwc_otg_22:05:352
3195699347,24cyclictest0-21swapper/222:35:332
3195699347,24cyclictest0-21swapper/220:55:252
3195699346,6cyclictest7950irq/56-dwc_otg_21:45:312
3195699342,10cyclictest7750irq/56-dwc_otg00:00:342
3195699342,10cyclictest7750irq/56-dwc_otg00:00:342
31956993411,5cyclictest206602timerandwakeup22:00:482
121742341,29sleep30-21swapper/323:49:313
3195799334,6cyclictest10420-21diskmemload23:50:463
3195799333,5cyclictest10649-21fschecks_count19:40:373
3195799333,17cyclictest7950irq/56-dwc_otg_22:47:373
3195799333,17cyclictest7950irq/56-dwc_otg_22:47:373
31957993325,6cyclictest27865-21rm23:28:593
3195799331,21cyclictest2094-21missed_timers20:45:413
3195699338,11cyclictest7950irq/56-dwc_otg_00:15:342
3195699336,6cyclictest7750irq/56-dwc_otg23:50:322
3195699332,5cyclictest7750irq/56-dwc_otg23:25:342
3195699331,18cyclictest32348-21ls22:55:202
3195699331,18cyclictest30059-21apt-key20:35:202
3195799322,25cyclictest7950irq/56-dwc_otg_22:40:313
3195799322,15cyclictest7950irq/56-dwc_otg_20:25:473
3195799322,14cyclictest7850irq/56-dwc_otg_23:25:193
3195799321,26cyclictest19759-21ls20:05:383
3195699327,15cyclictest0-21swapper/223:40:342
3195699323,14cyclictest7750irq/56-dwc_otg00:39:372
3195699322,9cyclictest15914-21ssh00:32:522
3195699321,7cyclictest17141-21grep23:55:332
3195699321,5cyclictest7850irq/56-dwc_otg_21:05:382
31956993213,5cyclictest31-21ksoftirqd/219:35:432
3195799319,4cyclictest0-21swapper/321:30:363
3195799317,4cyclictest7950irq/56-dwc_otg_21:40:203
3195799315,6cyclictest7950irq/56-dwc_otg_21:05:433
3195799314,7cyclictest7950irq/56-dwc_otg_22:11:123
3195799314,13cyclictest0-21swapper/322:52:443
3195699319,5cyclictest7850irq/56-dwc_otg_19:40:432
308412315,12sleep330126-21/usr/sbin/munin19:05:443
305592319,11sleep20-21swapper/219:05:392
3195799308,4cyclictest0-21swapper/321:19:003
3195799308,4cyclictest0-21swapper/321:19:003
3195799308,12cyclictest0-21swapper/322:36:403
3195799307,10cyclictest7750irq/56-dwc_otg23:55:353
3195799305,21cyclictest17605-21ssh00:35:343
3195799302,22cyclictest0-21swapper/320:58:223
3195799301,27cyclictest4937-21ls23:40:353
3195699309,3cyclictest0-21swapper/223:05:472
3195699307,14cyclictest0-21swapper/223:10:252
3195699302,9cyclictest32507-21perl20:40:362
3195699302,3cyclictest7950irq/56-dwc_otg_20:10:302
31956993014,5cyclictest29-21rcuc/219:24:492
31956993012,4cyclictest0-21swapper/222:43:432
3195799295,13cyclictest0-21swapper/300:00:473
3195799295,13cyclictest0-21swapper/300:00:473
3195799295,11cyclictest7950irq/56-dwc_otg_20:20:463
3195799292,21cyclictest0-21swapper/320:05:093
31957992921,6cyclictest381ktimersoftd/300:15:363
3195799291,5cyclictest7850irq/56-dwc_otg_19:50:323
31956992922,5cyclictest31-21ksoftirqd/219:20:192
3195699291,9cyclictest29425-21ssh00:10:312
3195699282,5cyclictest1590-21grep20:45:342
3195699281,4cyclictest7750irq/56-dwc_otg19:55:342
316002284,15sleep10-21swapper/119:09:141
3195799262,22cyclictest1122-21ls19:15:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional