You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 01:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Tue Sep 22, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1402622730,2sleep10-21swapper/107:05:471
1402622730,2sleep10-21swapper/107:05:471
152519910630,41cyclictest13552-21ssh09:35:390
152519910438,51cyclictest15250-21cyclictest07:10:280
152519910025,48cyclictest15778-21fschecks_time08:40:440
176922990,2sleep20-21swapper/211:45:252
121072990,4sleep312103-21ssh10:55:493
15251999723,60cyclictest14917-21modprobe11:00:250
15251999628,28cyclictest0-21swapper/009:55:410
15251999524,66cyclictest18663-21sed09:40:540
15251999424,50cyclictest19232-21aten_rbpower_en11:05:400
15251999223,46cyclictest0-21swapper/008:26:160
15251999216,56cyclictest0-21swapper/011:54:260
15251999129,58cyclictest14745-21unixbench_multi08:35:550
188042900,3sleep20-21swapper/209:41:002
15251999081,7cyclictest0-21swapper/009:53:260
15251999025,45cyclictest18632-21runrttasks08:48:160
15251998824,47cyclictest2739-21ssh10:44:320
15251998824,41cyclictest21639-21/usr/sbin/munin10:25:560
15251998821,53cyclictest15642-21ls11:00:440
15251998821,43cyclictest25708-21ssh10:31:150
78322870,2sleep30-21swapper/311:31:233
15251998722,61cyclictest31118-21ssh10:39:140
15251998718,52cyclictest0-21swapper/009:48:460
15251998717,57cyclictest24344-21grep11:10:550
15251998717,57cyclictest24344-21grep11:10:550
15251998621,42cyclictest17417-21wc10:20:540
133052860,6sleep21525399cyclictest10:57:132
15251998523,39cyclictest28192-21fschecks_count07:45:440
1525199851,24cyclictest0-21swapper/011:35:370
1525199851,24cyclictest0-21swapper/011:35:370
15251998430,35cyclictest26483-21sshd12:36:130
15251998430,35cyclictest26483-21sshd12:36:130
15251998422,39cyclictest7954-21rm10:09:520
15251998421,43cyclictest6253-21/usr/sbin/munin11:30:550
15251998331,29cyclictest2526-21ssh10:01:500
15251998319,49cyclictest31097-21taskset11:20:400
15251998318,53cyclictest0-21swapper/011:41:510
15251998223,41cyclictest22610-21ssh12:31:170
15251998221,47cyclictest0-21swapper/008:19:040
15251998220,44cyclictest17270-21taskset07:15:420
15251998218,45cyclictest0-21swapper/007:55:320
15251998218,45cyclictest0-21swapper/007:55:320
15251998216,50cyclictest0-21swapper/012:24:180
15251998216,50cyclictest0-21swapper/012:24:180
15251998131,32cyclictest2660-21forks11:25:430
15251998127,34cyclictest12277-21ssh12:19:050
15251998123,13cyclictest7950irq/56-dwc_otg_09:05:250
15251998119,46cyclictest0-21swapper/011:16:070
15251998116,49cyclictest0-21swapper/009:32:540
15251998023,13cyclictest19976-21ssh12:28:500
15251998021,40cyclictest0-21swapper/007:50:460
15251998020,43cyclictest3478-21runrttasks10:45:330
15251998019,43cyclictest18880-21chrt07:20:300
15251998018,50cyclictest0-21swapper/010:12:320
15251998018,46cyclictest0-21swapper/008:55:100
15251997923,42cyclictest32511-21ssh09:17:420
15251997917,46cyclictest0-21swapper/009:25:130
15251997827,30cyclictest27786-21ssh11:56:560
15251997823,34cyclictest19807-21rm11:46:500
15251997820,41cyclictest0-21swapper/008:09:320
15251997815,48cyclictest7160-21rm12:11:500
96992770,6sleep21525399cyclictest12:15:432
15251997722,43cyclictest12473-21/usr/sbin/munin10:15:370
15251997719,39cyclictest31850-21ssh12:02:030
15251997718,42cyclictest26329-21ssh09:10:330
15251997718,42cyclictest26329-21ssh09:10:330
15251997717,46cyclictest0-21swapper/008:10:560
15251997634,26cyclictest9509-21rm10:52:270
15251997530,8cyclictest24471-21apt-get09:05:360
15251997517,40cyclictest0-21swapper/009:25:310
15251997422,48cyclictest0-21swapper/008:55:330
15251997418,44cyclictest0-21swapper/012:05:440
1525499738,23cyclictest7950irq/56-dwc_otg_11:50:333
15252997215,47cyclictest0-21swapper/111:45:491
15251997221,40cyclictest0-21swapper/007:36:390
15251997121,35cyclictest2308-21taskset08:02:240
15251997120,47cyclictest0-21swapper/007:43:250
15251997019,39cyclictest0-21swapper/007:27:040
15254996823,41cyclictest17653-21if_eth012:25:443
15251996820,31cyclictest0-21swapper/008:31:220
15251996816,40cyclictest0-21swapper/008:20:370
15251996720,29cyclictest23966-21chrt07:34:200
1525499668,16cyclictest7950irq/56-dwc_otg_09:35:493
1525499652,6cyclictest7950irq/56-dwc_otg_09:05:253
1525499643,11cyclictest7950irq/56-dwc_otg_09:15:253
1525499643,11cyclictest7950irq/56-dwc_otg_09:15:253
1525499642,5cyclictest15222-21/usr/sbin/munin11:00:403
1525499639,11cyclictest7950irq/56-dwc_otg_07:20:253
1525499635,7cyclictest7750irq/56-dwc_otg10:20:473
15254996311,11cyclictest0-21swapper/312:37:023
15254996311,11cyclictest0-21swapper/312:37:023
15252996310,39cyclictest7950irq/56-dwc_otg_08:00:401
1525499629,12cyclictest0-21swapper/310:44:383
1525499628,4cyclictest0-21swapper/312:14:053
1525499623,12cyclictest7950irq/56-dwc_otg_09:05:423
1525499622,9cyclictest10989-21cron10:55:253
1525499622,6cyclictest7950irq/56-dwc_otg_07:55:453
1525499622,6cyclictest7950irq/56-dwc_otg_07:55:453
1525499622,5cyclictest7950irq/56-dwc_otg_11:05:553
1525499617,4cyclictest0-21swapper/310:12:343
1525499616,7cyclictest7950irq/56-dwc_otg_10:10:253
1525499611,6cyclictest20891-21wget08:55:403
1525499611,5cyclictest5364-21modprobe09:25:253
1525299612,9cyclictest0-21swapper/108:55:381
299342600,3sleep20-21swapper/210:36:542
1525499602,4cyclictest7950irq/56-dwc_otg_09:15:453
1525499602,12cyclictest0-21swapper/312:00:523
1525299607,21cyclictest0-21swapper/109:10:401
1525299607,21cyclictest0-21swapper/109:10:401
15252996023,15cyclictest21-21rcuc/108:35:521
1525299601,15cyclictest0-21swapper/110:30:421
1525499596,9cyclictest21740-21apt-config11:50:263
1525499592,7cyclictest7950irq/56-dwc_otg_11:10:513
1525499592,7cyclictest7950irq/56-dwc_otg_11:10:513
1525499591,4cyclictest25613-21awk09:50:443
1525499586,12cyclictest0-21swapper/311:28:193
1525499586,11cyclictest0-21swapper/309:45:233
1525499585,4cyclictest7750irq/56-dwc_otg10:49:233
1525499582,6cyclictest7950irq/56-dwc_otg_08:19:343
1525499581,5cyclictest31300-21awk07:55:253
1525499581,5cyclictest24701-21munin-run12:35:253
1525499581,5cyclictest10028-21fschecks_time09:30:473
1525499577,10cyclictest26040-21diskmemload09:48:573
1525499576,8cyclictest0-21swapper/309:55:393
1525499572,4cyclictest7950irq/56-dwc_otg_08:40:533
15254995717,5cyclictest3012-21sh08:05:423
1525499571,5cyclictest7950irq/56-dwc_otg_10:30:593
1525499567,5cyclictest0-21swapper/312:17:313
1525499565,3cyclictest0-21swapper/311:57:503
1525499562,10cyclictest7850irq/56-dwc_otg_11:25:073
15254995616,6cyclictest1180-21runrttasks07:45:533
1525499561,5cyclictest30857-21taskset10:38:433
1525499561,5cyclictest14110-21apt-get11:40:393
1525499561,17cyclictest0-21swapper/312:07:133
1525499561,10cyclictest7950irq/56-dwc_otg_07:20:423
1525399562,24cyclictest7750irq/56-dwc_otg08:10:402
1525499553,4cyclictest7750irq/56-dwc_otg10:05:223
1525499551,7cyclictest0-21swapper/311:35:263
1525499551,7cyclictest0-21swapper/311:35:263
1525499551,5cyclictest14078-21awk12:20:503
1525499551,5cyclictest14078-21awk12:20:503
15253995512,21cyclictest7750irq/56-dwc_otg10:15:402
1525299558,31cyclictest0-21swapper/111:05:401
1525299556,5cyclictest23-21ksoftirqd/110:55:381
15252995513,7cyclictest7950irq/56-dwc_otg_11:15:361
1525499544,3cyclictest0-21swapper/311:18:543
1525499542,6cyclictest0-21swapper/309:25:483
1525499541,8cyclictest17953-21ntp_states08:45:493
1525499541,11cyclictest0-21swapper/310:27:193
1525299548,28cyclictest13297-21ssh12:20:381
1525299548,28cyclictest13297-21ssh12:20:381
1525499538,28cyclictest0-21swapper/307:40:373
1525499531,13cyclictest39-21ksoftirqd/310:15:493
1525399534,9cyclictest0-21swapper/212:25:372
1525499521,3cyclictest0-21swapper/308:35:393
1525299528,28cyclictest0-21swapper/107:30:391
1525299527,28cyclictest25037-21ssh12:35:391
1525299527,28cyclictest25037-21ssh12:35:391
1525299526,18cyclictest7950irq/56-dwc_otg_09:15:421
1525499518,27cyclictest0-21swapper/307:25:393
1525299518,27cyclictest0-21swapper/108:25:391
15252995112,19cyclictest0-21swapper/107:35:391
1525399508,29cyclictest0-21swapper/207:50:392
1525399508,28cyclictest0-21swapper/208:45:392
1525399507,30cyclictest0-21swapper/208:25:392
1525299509,29cyclictest0-21swapper/108:45:391
1525299504,7cyclictest7750irq/56-dwc_otg11:50:411
15252995025,7cyclictest21-21rcuc/109:40:451
15252995010,25cyclictest0-21swapper/108:40:391
1525299497,27cyclictest0-21swapper/111:30:381
1525399485,9cyclictest31-21ksoftirqd/207:10:282
1525399485,10cyclictest0-21swapper/209:45:382
15253994811,20cyclictest0-21swapper/209:35:552
1525299487,26cyclictest0-21swapper/110:25:391
31572470,5sleep116203-21systemd-journal10:45:231
1525399479,5cyclictest7950irq/56-dwc_otg_11:00:372
1525399478,29cyclictest0-21swapper/208:05:402
1525299474,7cyclictest7850irq/56-dwc_otg_12:30:361
1525299472,7cyclictest21466-21ssh09:45:371
8142460,2sleep20-21swapper/211:23:002
1525399469,19cyclictest0-21swapper/208:55:382
1525399468,29cyclictest0-21swapper/207:55:312
1525399468,29cyclictest0-21swapper/207:55:312
1525399468,28cyclictest0-21swapper/208:40:392
1525399462,6cyclictest0-21swapper/211:55:372
15253994624,19cyclictest7950irq/56-dwc_otg_10:40:352
1525399461,4cyclictest0-21swapper/212:00:392
1525299469,25cyclictest0-21swapper/108:05:401
1525299469,17cyclictest21-21rcuc/111:10:531
1525299469,17cyclictest21-21rcuc/111:10:531
1525299468,27cyclictest0-21swapper/109:05:381
1525299468,27cyclictest0-21swapper/107:55:411
1525299468,27cyclictest0-21swapper/107:55:411
1525499458,29cyclictest0-21swapper/308:20:373
149382453,36sleep00-21swapper/007:09:560
149382453,36sleep00-21swapper/007:09:560
15253994416,14cyclictest7950irq/56-dwc_otg_11:35:402
15253994416,14cyclictest7950irq/56-dwc_otg_11:35:402
1525299442,6cyclictest7850irq/56-dwc_otg_10:50:421
1525399438,25cyclictest0-21swapper/209:05:382
1525399437,25cyclictest0-21swapper/209:25:392
15253994324,5cyclictest5962-21latency_hist11:30:252
15253994319,13cyclictest22438-21fschecks_time11:50:472
15253994318,5cyclictest0-21swapper/210:00:542
1525299438,20cyclictest0-21swapper/108:15:391
1525299436,7cyclictest7850irq/56-dwc_otg_11:40:381
1525299433,10cyclictest0-21swapper/107:15:401
1525299432,6cyclictest0-21swapper/109:20:401
1525299432,25cyclictest7750irq/56-dwc_otg10:02:091
15252994312,21cyclictest0-21swapper/110:46:151
1525399424,31cyclictest7950irq/56-dwc_otg_10:45:482
1525399422,14cyclictest7850irq/56-dwc_otg_11:10:362
1525399422,14cyclictest7850irq/56-dwc_otg_11:10:362
1525299425,6cyclictest7850irq/56-dwc_otg_11:20:391
1525299422,24cyclictest7750irq/56-dwc_otg09:35:551
15252994211,8cyclictest0-21swapper/110:15:571
1525399416,21cyclictest20339-21ssh10:25:392
1525399416,16cyclictest7850irq/56-dwc_otg_12:40:262
1525399416,16cyclictest7850irq/56-dwc_otg_12:40:262
15253994110,16cyclictest7950irq/56-dwc_otg_12:05:542
1525299415,7cyclictest7850irq/56-dwc_otg_12:15:421
15252994120,6cyclictest19640-21sh10:24:451
15252994113,13cyclictest7750irq/56-dwc_otg10:05:401
1525399406,23cyclictest21119-21ssh12:30:382
1525399405,5cyclictest7850irq/56-dwc_otg_08:35:362
1525399405,21cyclictest17069-21/usr/sbin/munin07:15:532
1525399404,21cyclictest7950irq/56-dwc_otg_09:30:392
1525399401,29cyclictest9698-21ssh10:10:582
1525299409,19cyclictest0-21swapper/112:25:391
1525299402,4cyclictest0-21swapper/107:10:371
1525299402,26cyclictest7750irq/56-dwc_otg11:00:431
1525299401,10cyclictest28179-21grep07:45:441
15254993910,12cyclictest7950irq/56-dwc_otg_08:10:413
1525399396,14cyclictest7850irq/56-dwc_otg_09:55:252
15253993913,15cyclictest0-21swapper/211:50:022
1525399391,28cyclictest12082-21cut08:30:442
1525399391,21cyclictest26027-21kworker/u8:109:15:262
1525399391,21cyclictest26027-21kworker/u8:109:15:262
1525299397,15cyclictest0-21swapper/111:35:371
1525299397,15cyclictest0-21swapper/111:35:371
1525299396,19cyclictest23-21ksoftirqd/109:54:041
1525299393,29cyclictest7750irq/56-dwc_otg10:12:311
1525299391,34cyclictest30075-21ls07:50:441
1525299391,28cyclictest8579-21ls08:20:431
15252993911,17cyclictest0-21swapper/110:36:461
92332380,2sleep20-21swapper/212:15:272
1525399383,24cyclictest0-21swapper/210:53:132
15253993810,15cyclictest0-21swapper/210:20:352
1525299388,18cyclictest0-21swapper/112:00:321
1525299388,15cyclictest7950irq/56-dwc_otg_09:30:461
1525299386,17cyclictest21-21rcuc/108:50:401
1525299382,5cyclictest7950irq/56-dwc_otg_07:40:351
1525299382,5cyclictest0-21swapper/109:00:401
15252993813,15cyclictest31840-21ssh09:58:251
1525299381,10cyclictest27213-21grep11:55:551
1525499379,17cyclictest0-21swapper/308:50:403
1525399378,17cyclictest0-21swapper/211:05:402
1525399378,17cyclictest0-21swapper/209:00:402
15253993714,14cyclictest0-21swapper/211:18:532
15253993714,13cyclictest8307-21aten_rbpower_po08:20:382
1525399371,25cyclictest0-21swapper/207:25:442
1525299377,8cyclictest0-21swapper/111:25:381
15252993718,6cyclictest1435-21/usr/sbin/munin12:05:561
15252993710,12cyclictest7750irq/56-dwc_otg09:27:171
1525399369,18cyclictest0-21swapper/208:52:232
1525399368,17cyclictest0-21swapper/207:45:402
1525399368,17cyclictest0-21swapper/207:30:392
1525399364,7cyclictest0-21swapper/209:15:382
1525399363,23cyclictest0-21swapper/209:23:522
1525399362,23cyclictest1096-21aten_rbpower_vo08:00:412
1525399361,23cyclictest0-21swapper/210:08:042
1525399361,22cyclictest27848-21latency_hist07:45:262
15253993611,15cyclictest7950irq/56-dwc_otg_09:55:452
1525299368,17cyclictest0-21swapper/107:20:391
1525299364,20cyclictest20824-21egrep07:25:401
1525299362,5cyclictest7850irq/56-dwc_otg_08:10:451
1525299361,18cyclictest7750irq/56-dwc_otg12:14:191
1525499355,6cyclictest7750irq/56-dwc_otg08:00:413
1525499351,25cyclictest0-21swapper/307:33:333
1525399359,16cyclictest0-21swapper/210:34:052
1525399357,17cyclictest0-21swapper/212:20:382
1525399357,17cyclictest0-21swapper/212:20:382
1525299352,25cyclictest0-21swapper/108:35:221
1525499333,21cyclictest0-21swapper/308:26:553
1525399336,14cyclictest7054-21ssh11:30:482
1525399334,14cyclictest7850irq/56-dwc_otg_07:35:452
1525399331,22cyclictest0-21swapper/208:17:192
1525499325,19cyclictest60-21kswapd007:10:393
1525499321,18cyclictest0-21swapper/308:33:403
1525399322,24cyclictest0-21swapper/207:20:392
1525499311,22cyclictest0-21swapper/307:36:043
150312286,13sleep215014-21ls07:10:272
150312286,13sleep215014-21ls07:10:272
149642273,15sleep30-21swapper/307:10:153
149642273,15sleep30-21swapper/307:10:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional