You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 03:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Mon Jul 13, 2026 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2009626230,5sleep00-21swapper/019:05:430
1974925670,5sleep20-21swapper/219:05:372
1808021830,5sleep32105999cyclictest22:10:423
3250821200,2sleep20-21swapper/200:25:412
3250821200,2sleep20-21swapper/200:25:412
2105699862,71cyclictest0-21swapper/021:30:380
305922820,5sleep12105799cyclictest21:46:081
68942810,2sleep02105699cyclictest21:18:210
71282790,2sleep00-21swapper/021:57:260
85942770,5sleep12105799cyclictest23:17:271
2105699774,50cyclictest0-21swapper/023:40:310
2105699756,29cyclictest0-21swapper/019:15:310
2105999741,25cyclictest0-21swapper/319:15:313
2105699741,7cyclictest13436-21idleruntime-cro22:45:170
2105799735,43cyclictest0-21swapper/121:30:381
78662710,2sleep20-21swapper/221:20:082
2105699717,12cyclictest26655-21sort23:00:340
21056997011,46cyclictest28589-21rm00:20:440
21057996813,19cyclictest8050irq/56-dwc_otg_21:05:311
2105699689,41cyclictest11593-21awk00:00:380
2105699681,52cyclictest0-21swapper/021:25:320
21056996811,54cyclictest101ktimersoftd/021:50:170
2105699674,52cyclictest682-21ssh21:50:230
2105699666,46cyclictest5262-21tune2fs19:55:350
21056996632,3cyclictest0-21swapper/000:30:290
2105699662,47cyclictest0-21swapper/020:10:470
2105699662,47cyclictest0-21swapper/020:10:470
2105699661,49cyclictest7570-21unixbench_multi23:15:460
21056996614,40cyclictest101ktimersoftd/023:55:180
202312660,2sleep20-21swapper/222:13:472
139402650,35sleep18050irq/56-dwc_otg_20:20:171
2105699648,44cyclictest24109-21rm22:18:160
2105699645,49cyclictest0-21swapper/000:18:160
2105699638,44cyclictest0-21swapper/020:55:460
2105699638,31cyclictest101ktimersoftd/022:20:370
2105699632,46cyclictest14945-21grep23:25:350
2105699621,45cyclictest0-21swapper/023:20:280
2105699621,45cyclictest0-21swapper/023:20:280
21056996210,39cyclictest27575-21sed19:25:440
2105699616,42cyclictest0-21swapper/023:50:170
2105699615,45cyclictest26422-21runrttasks21:41:030
2105699612,49cyclictest17107-21latency_hist22:10:170
2105699612,46cyclictest3082-21awk00:30:170
2105699612,46cyclictest3082-21awk00:30:170
21056996113,33cyclictest101ktimersoftd/020:25:300
21056996110,37cyclictest101ktimersoftd/022:55:220
191272610,2sleep30-21swapper/322:50:443
21058996031,23cyclictest17221-21memory21:30:402
2105699607,38cyclictest0-21swapper/023:09:260
2105699606,40cyclictest0-21swapper/022:00:420
2105699602,46cyclictest8428-21wget21:20:310
2105699601,4cyclictest20699-21unixbench_singl20:35:460
2105699601,49cyclictest11327-21modprobe00:40:160
2105699601,46cyclictest16127-21/usr/sbin/munin00:05:430
21056995910,40cyclictest1171-21grep21:10:470
2105699582,47cyclictest21155-21if_err_eth021:35:350
2105699582,47cyclictest0-21swapper/022:25:320
2105699582,47cyclictest0-21swapper/022:25:320
2105699582,46cyclictest0-21swapper/023:58:000
2105699582,44cyclictest5480-21/usr/sbin/munin22:35:340
2105699581,46cyclictest31992-21sort21:10:170
2105699579,38cyclictest101ktimersoftd/000:15:170
2105699573,44cyclictest0-21swapper/019:30:360
2105699573,41cyclictest0-21swapper/019:20:460
2105699573,41cyclictest0-21swapper/019:20:460
2105699572,46cyclictest20079-21ssh22:52:100
2105699572,43cyclictest21847-21grep19:10:430
229152560,3sleep1221ktimersoftd/123:35:311
2105699568,36cyclictest101ktimersoftd/019:50:320
2105699568,35cyclictest0-21swapper/020:06:310
2105699563,45cyclictest14110-21ssh22:45:330
2105699562,41cyclictest31953-21diskmemload23:37:440
2105699561,46cyclictest2984-21/usr/sbin/munin23:10:410
21056995611,42cyclictest101ktimersoftd/022:35:060
171632560,2sleep10-21swapper/100:06:561
2105699559,38cyclictest14453-21fschecks_time20:20:350
2105699552,44cyclictest18859-21aten_rbpower_po23:30:320
2105699551,43cyclictest0-21swapper/020:50:290
2105699551,42cyclictest0-21swapper/020:40:400
2105699551,41cyclictest6843-21wget20:00:290
21056995512,32cyclictest101ktimersoftd/020:50:180
21056995430,5cyclictest23456-21fschecks_time20:45:350
201502540,2sleep10-21swapper/120:35:391
21056995310,33cyclictest101ktimersoftd/020:17:160
2105699524,36cyclictest0-21swapper/022:10:450
299132510,1sleep20-21swapper/223:04:482
2105699511,9cyclictest2538-21grep19:45:440
21059995011,11cyclictest39-21ksoftirqd/321:30:403
2105699503,36cyclictest0-21swapper/021:00:540
21056995025,4cyclictest7950irq/56-dwc_otg_19:45:160
2105799497,27cyclictest0-21swapper/121:25:311
2105699492,24cyclictest19176-21rm20:33:390
2105799477,25cyclictest0-21swapper/120:00:281
21056994716,5cyclictest30262-21aten_rbpower_cu19:35:300
21059994638,6cyclictest8050irq/56-dwc_otg_21:10:303
2105799469,7cyclictest7850irq/56-dwc_otg23:20:281
2105799469,7cyclictest7850irq/56-dwc_otg23:20:281
2105999451,29cyclictest25287-21ls22:20:173
2105799451,32cyclictest0-21swapper/100:20:281
22412440,2sleep20-21swapper/223:10:322
2105799447,27cyclictest0-21swapper/123:25:311
2105799444,30cyclictest7850irq/56-dwc_otg19:25:421
21058994320,5cyclictest2835650wget19:30:302
21058994317,5cyclictest29051-21/usr/sbin/munin21:45:382
21057994322,8cyclictest23-21ksoftirqd/122:40:371
224952420,2sleep20-21swapper/223:35:122
2105999429,8cyclictest39-21ksoftirqd/300:29:453
2105999429,8cyclictest39-21ksoftirqd/300:29:453
21058994217,6cyclictest7645-21aten_rbpower_vo00:35:322
21058994216,12cyclictest8050irq/56-dwc_otg_22:24:142
21057994218,5cyclictest5729-21df22:35:331
251332410,1sleep10-21swapper/122:20:101
21059994114,6cyclictest39-21ksoftirqd/321:50:173
2105899415,13cyclictest8050irq/56-dwc_otg_23:46:232
2105899411,10cyclictest8050irq/56-dwc_otg_21:35:282
21059994018,6cyclictest39-21ksoftirqd/323:20:413
21059994018,6cyclictest39-21ksoftirqd/323:20:413
21058994018,6cyclictest29672-21sh22:25:282
21058994018,6cyclictest29672-21sh22:25:282
21058994016,6cyclictest14425-21latency_hist23:25:182
21058994016,6cyclictest14425-21latency_hist23:25:182
21058994016,13cyclictest8050irq/56-dwc_otg_22:46:342
21057994013,18cyclictest0-21swapper/119:15:311
201182400,1sleep10-21swapper/122:13:341
40002391,2sleep10-21swapper/123:50:461
2105999397,9cyclictest39-21ksoftirqd/319:20:443
2105999397,9cyclictest39-21ksoftirqd/319:20:443
2105999392,11cyclictest8050irq/56-dwc_otg_23:00:283
2105999391,7cyclictest61-21kswapd000:05:283
2105999391,30cyclictest8878-21ls22:00:183
2105899392,22cyclictest10699-21ssh22:01:262
21058993917,5cyclictest1829-21if_eth022:30:362
2105899391,11cyclictest8050irq/56-dwc_otg_00:00:292
2105799395,25cyclictest13808-21ssh22:45:241
2105799392,24cyclictest7850irq/56-dwc_otg20:30:171
21057993910,13cyclictest21-21rcuc/123:40:461
2105999387,19cyclictest381ktimersoftd/322:30:253
2105999386,15cyclictest37-21rcuc/321:36:313
2105999385,9cyclictest39-21ksoftirqd/300:20:393
2105999384,19cyclictest381ktimersoftd/323:43:313
2105999383,4cyclictest8050irq/56-dwc_otg_21:25:293
2105999383,21cyclictest37-21rcuc/300:37:493
21059993819,4cyclictest381ktimersoftd/322:40:463
21059993816,13cyclictest381ktimersoftd/300:03:553
2105899388,11cyclictest301ktimersoftd/221:50:422
21058993814,6cyclictest301ktimersoftd/219:50:282
21057993819,12cyclictest21-21rcuc/100:10:291
2105799381,22cyclictest28482-21ls21:00:171
2105999378,6cyclictest39-21ksoftirqd/320:55:473
2105999376,16cyclictest37-21rcuc/322:46:323
2105999374,8cyclictest39-21ksoftirqd/319:55:363
2105899379,19cyclictest301ktimersoftd/223:06:192
21058993719,11cyclictest26660-21sh21:41:282
21058993715,14cyclictest21199-21wget19:10:322
21058993714,4cyclictest7850irq/56-dwc_otg22:15:292
21058993712,5cyclictest727-21runrttasks00:33:172
21058993712,5cyclictest26597-21aten_rbpower_po19:25:312
2105899371,16cyclictest14138-21ssh22:05:442
2105899371,11cyclictest31953-21diskmemload23:59:302
2105799379,15cyclictest0-21swapper/123:48:111
2105799376,21cyclictest3476-21aten_rbpower_en00:30:321
2105799373,23cyclictest7850irq/56-dwc_otg23:00:311
2105799372,22cyclictest0-21swapper/123:05:281
2105799371,27cyclictest1157-21latency_hist19:45:171
2105999369,9cyclictest39-21ksoftirqd/323:55:183
2105999367,9cyclictest39-21ksoftirqd/322:35:323
2105999361,6cyclictest8050irq/56-dwc_otg_19:40:293
21059993612,13cyclictest29630-21/usr/sbin/munin22:25:413
21059993612,13cyclictest29630-21/usr/sbin/munin22:25:413
2105899366,20cyclictest301ktimersoftd/223:40:382
2105899366,14cyclictest301ktimersoftd/200:06:202
2105899365,25cyclictest0-21swapper/220:21:422
2105899365,15cyclictest0-21swapper/222:35:472
2105899364,24cyclictest0-21swapper/223:25:252
21058993617,13cyclictest7950irq/56-dwc_otg_21:55:362
2105799365,6cyclictest7850irq/56-dwc_otg21:40:171
2105799364,7cyclictest0-21swapper/123:55:311
21057993624,5cyclictest1454-21ssh21:11:131
21057993616,9cyclictest7850irq/56-dwc_otg21:45:171
21057993616,12cyclictest0-21swapper/100:00:491
21057993612,6cyclictest0-21swapper/121:22:341
2105799361,23cyclictest7850irq/56-dwc_otg22:00:451
2105799361,19cyclictest0-21swapper/122:30:161
2105799361,19cyclictest0-21swapper/122:30:161
95622351,28sleep20-21swapper/220:05:462
2105999358,8cyclictest39-21ksoftirqd/323:09:043
2105999356,8cyclictest39-21ksoftirqd/323:29:263
2105999353,18cyclictest727-21runrttasks23:10:393
21059993518,5cyclictest39-21ksoftirqd/319:50:173
2105999351,6cyclictest20654-21unixbench_multi20:35:463
2105999351,5cyclictest0-21swapper/322:20:293
2105999351,12cyclictest39-21ksoftirqd/321:17:173
21058993511,9cyclictest8050irq/56-dwc_otg_23:52:072
21058993511,8cyclictest8050irq/56-dwc_otg_19:55:402
21058993511,6cyclictest301ktimersoftd/200:23:372
2105899351,11cyclictest31-21ksoftirqd/221:22:462
2105799356,5cyclictest7850irq/56-dwc_otg22:30:341
21057993514,13cyclictest2429-21ssh21:51:241
230862340,2sleep323032-21ssh23:35:333
2105999347,7cyclictest21053-21cyclictest20:32:503
2105999346,11cyclictest381ktimersoftd/323:49:113
21059993417,10cyclictest2090150ssh23:32:173
21059993417,10cyclictest13448-21ssh22:05:343
21059993414,6cyclictest29970-21sed19:35:173
2105999341,16cyclictest39-21ksoftirqd/321:24:453
21059993411,5cyclictest381ktimersoftd/320:20:223
2105899348,5cyclictest7950irq/56-dwc_otg_19:35:312
2105899344,10cyclictest31-21ksoftirqd/222:55:172
2105899343,24cyclictest0-21swapper/220:45:572
2105899343,24cyclictest0-21swapper/220:45:572
21058993415,4cyclictest301ktimersoftd/220:55:402
21058993413,8cyclictest0-21swapper/221:29:492
21058993413,11cyclictest25462-21ssh00:17:002
21058993412,10cyclictest26368-21ssh23:39:442
21058993410,5cyclictest32071-1kworker/u9:221:10:432
2105799343,6cyclictest0-21swapper/121:15:311
21057993424,7cyclictest11980-21sh20:15:171
21057993424,7cyclictest11980-21sh20:15:171
2105799341,6cyclictest2512-21unixbench_multi19:45:441
21057993415,4cyclictest21356-21/usr/sbin/munin20:40:361
2105799341,21cyclictest0-21swapper/100:25:511
2105799341,21cyclictest0-21swapper/100:25:511
2105799341,11cyclictest0-21swapper/123:35:011
21057993410,6cyclictest18377-21fschecks_time22:50:341
200512347,14sleep319240-21/usr/sbin/munin19:05:433
2105999336,16cyclictest37-21rcuc/321:50:393
2105999332,24cyclictest0-21swapper/320:54:383
2105999332,21cyclictest0-21swapper/321:06:243
2105999332,18cyclictest0-21swapper/300:15:293
21059993316,5cyclictest6595-21sh23:15:343
2105999331,26cyclictest0-21swapper/319:50:413
2105999331,16cyclictest19328-21ssh00:10:293
2105899339,5cyclictest0-21swapper/222:56:542
2105899332,4cyclictest8050irq/56-dwc_otg_20:35:312
2105899331,9cyclictest7950irq/56-dwc_otg_20:35:172
21058993314,4cyclictest8050irq/56-dwc_otg_20:25:292
2105899331,11cyclictest31-21ksoftirqd/220:17:412
2105799338,5cyclictest7850irq/56-dwc_otg22:06:491
2105799337,7cyclictest23-21ksoftirqd/121:55:441
2105799331,9cyclictest4273-21grep19:50:451
21057993315,9cyclictest7850irq/56-dwc_otg20:50:451
21057993315,5cyclictest23173-21/usr/sbin/munin20:45:291
21057993315,5cyclictest23173-21/usr/sbin/munin20:45:291
2105999325,17cyclictest381ktimersoftd/322:55:233
21059993218,8cyclictest381ktimersoftd/322:01:493
2105999321,25cyclictest0-21swapper/300:34:593
21059993212,4cyclictest381ktimersoftd/320:25:303
2105999321,17cyclictest0-21swapper/320:07:303
2105999321,11cyclictest11-21rcu_preempt19:25:433
21059993210,5cyclictest0-21swapper/323:55:463
21059993210,15cyclictest0-21swapper/321:40:203
2105899329,4cyclictest0-21swapper/200:13:212
2105899321,7cyclictest1159-21awk19:45:162
2105899321,4cyclictest8050irq/56-dwc_otg_22:40:312
21058993213,6cyclictest7950irq/56-dwc_otg_23:17:362
2105799327,6cyclictest8050irq/56-dwc_otg_19:30:331
2105799327,6cyclictest21-21rcuc/119:20:381
2105799327,6cyclictest21-21rcuc/119:20:381
2105799324,17cyclictest23-21ksoftirqd/119:15:171
2105799322,8cyclictest21-21rcuc/119:55:291
2105799322,15cyclictest23747-21rm00:15:341
21057993216,8cyclictest221ktimersoftd/119:36:481
21057993210,10cyclictest0-21swapper/100:37:251
2105799316,13cyclictest8050irq/56-dwc_otg_23:10:371
2105799312,15cyclictest26140-21latency_hist23:00:181
21057993116,5cyclictest28879-21fschecks_time21:00:311
2105799311,19cyclictest14379-21grep20:20:341
21057993111,12cyclictest26462-21/usr/sbin/munin22:20:431
2105999305,5cyclictest37-21rcuc/320:14:593
2105999305,5cyclictest37-21rcuc/320:14:593
2105999304,8cyclictest0-21swapper/320:01:063
2105999301,3cyclictest0-21swapper/319:10:413
2105999301,17cyclictest0-21swapper/320:46:313
2105999301,17cyclictest0-21swapper/320:46:313
21058993010,4cyclictest1752-21idleruntime19:45:342
2105799306,12cyclictest8050irq/56-dwc_otg_20:10:171
254692290,1sleep20-21swapper/220:50:372
2105999293,20cyclictest0-21swapper/319:36:553
21059992916,7cyclictest381ktimersoftd/321:00:373
2105999291,5cyclictest21940-21wc20:40:393
2105899299,8cyclictest7950irq/56-dwc_otg_19:17:472
2105899299,8cyclictest29-21rcuc/221:00:542
2105899298,8cyclictest0-21swapper/220:14:312
2105899298,8cyclictest0-21swapper/220:14:312
2105899295,4cyclictest7950irq/56-dwc_otg_20:00:292
2105899294,13cyclictest25773-21sed19:20:462
2105899294,13cyclictest25773-21sed19:20:462
2105799298,6cyclictest23-21ksoftirqd/120:30:461
2105899281,10cyclictest0-21swapper/220:41:072
2105999273,12cyclictest8050irq/56-dwc_otg_20:17:243
2105899271,4cyclictest7850irq/56-dwc_otg21:05:372
205812273,14sleep10-21swapper/119:07:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional