You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 08:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Sat Sep 05, 2026 00:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2426526300,6sleep10-21swapper/119:05:331
257499910615,69cyclictest25959-21timerwakeupswit00:10:450
257499910216,62cyclictest7950irq/56-dwc_otg_00:30:430
257499910119,75cyclictest0-21swapper/019:30:280
257539910040,36cyclictest25907-21ls00:10:443
126312930,2sleep20-21swapper/220:00:432
25753998842,29cyclictest7950irq/56-dwc_otg_00:30:413
2575299882,55cyclictest7950irq/56-dwc_otg_00:30:422
25749998764,5cyclictest0-21swapper/023:11:310
2574999873,56cyclictest0-21swapper/023:50:260
2574999856,65cyclictest0-21swapper/020:05:280
177282840,5sleep12575199cyclictest22:43:011
2575299832,72cyclictest25977-21date00:10:452
2574999836,61cyclictest0-21swapper/023:55:290
166142830,5sleep12575199cyclictest23:20:371
2575199823,59cyclictest9982-21ls00:30:431
2574999826,46cyclictest0-21swapper/023:35:270
2574999821,36cyclictest0-21swapper/022:45:280
25751997818,36cyclictest7750irq/56-dwc_otg00:10:441
17842780,2sleep11786-21rm23:41:351
2575399767,18cyclictest7950irq/56-dwc_otg_21:15:283
2575199726,18cyclictest0-21swapper/119:50:261
2575199714,16cyclictest7750irq/56-dwc_otg22:20:281
2575299698,13cyclictest7850irq/56-dwc_otg_21:05:272
25749996945,16cyclictest28908-21grep20:45:440
25753996826,4cyclictest21658-21apt-get21:30:273
25749996821,26cyclictest19006-21fschecks_time20:20:320
25749996821,26cyclictest19006-21fschecks_time20:20:320
2575299672,46cyclictest7850irq/56-dwc_otg_00:05:402
2575299671,51cyclictest20840-21ssh23:25:412
2575299671,50cyclictest0-21swapper/223:55:162
2575299671,50cyclictest0-21swapper/223:46:242
2575299671,50cyclictest0-21swapper/223:46:242
25749996748,13cyclictest0-21swapper/020:35:290
2575299661,48cyclictest4208-21diskmemload00:20:542
2575199664,12cyclictest7750irq/56-dwc_otg20:00:261
2575199653,12cyclictest7750irq/56-dwc_otg23:55:261
2574999652,27cyclictest0-21swapper/023:20:270
25749996518,20cyclictest0-21swapper/020:45:150
135782650,2sleep00-21swapper/022:37:570
2575299643,47cyclictest9690-21aten_rbpower_cu19:55:292
25749996420,14cyclictest3697-21chrt22:25:410
25749996420,14cyclictest3697-21chrt22:25:410
25749996412,36cyclictest101ktimersoftd/019:55:150
243252640,3sleep224320-21ssh22:50:392
79272630,2sleep30-21swapper/323:10:333
2575299632,53cyclictest1172-21date19:30:362
2575299632,38cyclictest7850irq/56-dwc_otg_23:40:162
2575299631,50cyclictest13909-21ssh23:17:162
2575299631,50cyclictest13909-21ssh23:17:162
25749996338,10cyclictest26777-21proc_pri21:35:400
2575299621,50cyclictest18109-21ssh22:43:432
25751996218,3cyclictest7750irq/56-dwc_otg23:00:261
25749996234,12cyclictest101ktimersoftd/021:55:160
25749996224,18cyclictest0-21swapper/019:35:410
25753996125,13cyclictest11156-21/usr/sbin/munin21:55:383
25753996125,13cyclictest11156-21/usr/sbin/munin21:55:383
2575299611,52cyclictest25169-21ssh22:12:382
2575299611,46cyclictest4018-21ssh21:46:582
2575299611,40cyclictest5906-21ssh21:10:472
25751996115,10cyclictest7950irq/56-dwc_otg_23:25:291
2574999611,22cyclictest13372-21ls00:35:330
2575299604,42cyclictest7950irq/56-dwc_otg_21:55:262
2575299604,42cyclictest7950irq/56-dwc_otg_21:55:262
2575299602,42cyclictest0-21swapper/223:59:592
2575299601,48cyclictest0-21swapper/221:39:592
2575299601,44cyclictest32204-21ssh22:20:442
2575299601,44cyclictest0-21swapper/221:30:262
2575299601,43cyclictest10708-21modprobe22:35:152
2575299601,3cyclictest7950irq/56-dwc_otg_22:15:232
2574999602,36cyclictest4129-21apt-get23:45:260
2574999602,36cyclictest4129-21apt-get23:45:260
25753995926,22cyclictest2050-21ssh23:03:263
2575399591,22cyclictest0-21swapper/319:50:283
2575299592,40cyclictest0-21swapper/221:52:332
2575299591,46cyclictest4655-21sh00:25:222
25749995936,10cyclictest101ktimersoftd/022:20:420
25749995933,5cyclictest20345-21modprobe00:05:160
25749995918,26cyclictest1180-21runrttasks20:00:310
2574999591,54cyclictest101ktimersoftd/023:25:350
25753995824,11cyclictest15285-21basename22:40:293
25753995821,14cyclictest21701-21users20:25:443
25753995820,11cyclictest5842-21grep21:10:443
25753995819,22cyclictest14978-21ssh21:21:383
2575299582,45cyclictest0-21swapper/200:17:402
2575299582,41cyclictest0-21swapper/219:45:262
2575299581,5cyclictest20462-21ssh22:06:362
2575299581,4cyclictest19765-21ssh21:27:342
2575299581,45cyclictest0-21swapper/222:57:242
2575299581,45cyclictest0-21swapper/222:57:242
2575299581,44cyclictest0-21swapper/223:40:222
2575299581,38cyclictest28765-21sort20:45:432
2574999585,16cyclictest101ktimersoftd/021:10:330
25749995837,11cyclictest101ktimersoftd/022:34:440
2574999580,43cyclictest9683-21apt-get19:55:260
25753995726,12cyclictest7850irq/56-dwc_otg_22:20:433
2575299573,41cyclictest7950irq/56-dwc_otg_20:20:162
2575299572,40cyclictest0-21swapper/223:14:422
2575299571,4cyclictest25826-21ssh23:31:202
2575299571,45cyclictest0-21swapper/200:05:142
2575299571,38cyclictest3269-21if_wlan022:25:342
2575299571,38cyclictest3269-21if_wlan022:25:342
25749995736,6cyclictest7950irq/56-dwc_otg_21:05:160
25749995730,10cyclictest21508-21/usr/sbin/munin20:25:430
2574999571,30cyclictest6365-21fschecks_time19:45:320
25753995626,17cyclictest16621-21sshd20:14:553
25753995622,22cyclictest12218-21/usr/sbin/munin20:00:393
25753995620,11cyclictest1974-21apt-get21:45:263
2575299562,41cyclictest7950irq/56-dwc_otg_23:02:082
2575299561,45cyclictest14405-21ssh00:35:582
2575299561,41cyclictest0-21swapper/223:20:352
2575299561,37cyclictest7950irq/56-dwc_otg_19:30:162
2575299561,35cyclictest0-21swapper/222:37:042
2575299561,33cyclictest0-21swapper/221:41:192
25752995612,41cyclictest26649-21ntp_states20:40:392
2575199562,14cyclictest0-21swapper/120:05:261
2574999567,27cyclictest7387-21cat23:10:160
2574999564,27cyclictest0-21swapper/021:10:160
25749995641,3cyclictest0-21swapper/000:16:290
2574999563,31cyclictest0-21swapper/019:15:450
25749995632,7cyclictest101ktimersoftd/000:24:520
2574999561,36cyclictest0-21swapper/022:50:270
2574999561,27cyclictest11587-21ssh21:55:440
2574999561,27cyclictest11587-21ssh21:55:440
25753995530,15cyclictest28308-21/usr/sbin/munin20:45:363
25753995524,19cyclictest3496-21/usr/sbin/munin19:35:433
25753995519,20cyclictest22583-21taskset22:49:213
2575299558,31cyclictest7950irq/56-dwc_otg_23:05:432
2575299552,32cyclictest0-21swapper/219:35:432
2575299551,49cyclictest18726-21apt-get20:20:292
2575299551,49cyclictest18726-21apt-get20:20:292
2575299551,35cyclictest0-21swapper/221:16:292
2575299551,34cyclictest0-21swapper/220:27:122
2575199557,33cyclictest0-21swapper/119:15:311
25749995521,6cyclictest0-21swapper/023:15:250
25749995521,6cyclictest0-21swapper/023:15:250
25753995426,16cyclictest26837-21/usr/sbin/munin21:35:413
25753995425,15cyclictest4004-21sshd21:07:563
25753995422,13cyclictest25663-21sshd20:39:563
25753995420,12cyclictest8891-21ssh22:31:563
25753995418,20cyclictest7278-21ssh23:49:053
25753995418,20cyclictest7278-21ssh23:49:053
25753995416,10cyclictest7950irq/56-dwc_otg_23:40:163
2575299541,4cyclictest20808-21ssh22:46:062
2575299541,40cyclictest7950irq/56-dwc_otg_20:31:242
25749995438,9cyclictest101ktimersoftd/023:31:150
25749995434,4cyclictest15235-21runrttasks22:40:280
2574999541,29cyclictest23082-21wc20:30:380
25753995325,11cyclictest518-21in:imuxsock23:31:353
25753995323,11cyclictest19132-21/usr/sbin/munin22:05:353
25753995322,20cyclictest26861-21ssh22:54:363
25753995322,12cyclictest27538-21/usr/sbin/munin22:55:403
25753995322,12cyclictest27538-21/usr/sbin/munin22:55:403
25753995320,22cyclictest15891-21rm23:20:253
25753995318,12cyclictest4826-21rm23:05:553
25753995317,19cyclictest17744-21ssh22:04:113
25753995315,15cyclictest9966-21ssh23:51:263
2575299532,41cyclictest7950irq/56-dwc_otg_22:01:242
2575299531,40cyclictest14531-21taskset20:06:162
2575299531,36cyclictest0-21swapper/221:24:242
25749995333,8cyclictest0-21swapper/021:46:550
25749995329,13cyclictest101ktimersoftd/023:00:350
25749995326,5cyclictest30147-21/usr/sbin/munin21:40:380
25749995315,24cyclictest0-21swapper/020:50:290
25753995224,17cyclictest315-21modprobe19:30:163
25753995224,10cyclictest7323-21sshd00:28:063
25753995223,13cyclictest16242-21snmpd21:52:343
25753995218,12cyclictest19040-21perl20:20:333
25753995218,12cyclictest19040-21perl20:20:333
2575299522,46cyclictest27900-21fschecks_time19:15:352
2575299521,47cyclictest24446-21fschecks_time20:35:332
25749995238,4cyclictest101ktimersoftd/022:04:030
25749995233,9cyclictest101ktimersoftd/021:30:170
25749995231,6cyclictest7950irq/56-dwc_otg_19:25:400
25753995123,7cyclictest7950irq/56-dwc_otg_19:55:293
25753995120,18cyclictest25147-21ssh22:12:373
2575299512,46cyclictest4433-21fschecks_count19:40:322
2575299512,41cyclictest0-21swapper/220:56:272
2575199511,30cyclictest30050-21ls20:50:361
2574999518,7cyclictest25748-21cyclictest21:30:260
25749995129,11cyclictest14334-21unixbench_multi21:20:430
2574999512,38cyclictest0-21swapper/000:05:410
25753995022,15cyclictest2344-21ssh23:42:353
25753995022,12cyclictest26909-21ssh22:15:243
25753995021,19cyclictest16203-21systemd-journal00:16:333
25753995021,18cyclictest20627-21ssh00:05:253
25753995019,21cyclictest14739-21ssh00:36:343
25753995019,14cyclictest0-21swapper/323:56:463
25753995016,11cyclictest7950irq/56-dwc_otg_22:26:453
25753995016,11cyclictest7950irq/56-dwc_otg_22:26:453
2575199508,25cyclictest0-21swapper/120:30:271
25749995032,5cyclictest101ktimersoftd/022:55:350
25749995032,5cyclictest101ktimersoftd/022:55:350
25749995029,7cyclictest9374-21ssh21:15:350
25753994922,17cyclictest13854-21ssh23:17:093
25753994922,17cyclictest13854-21ssh23:17:093
25753994916,19cyclictest994-21ssh21:44:083
25753994914,21cyclictest23086-21ssh23:28:543
2575299492,44cyclictest8133-21fschecks_count19:50:322
2575299492,43cyclictest970-21fschecks_count21:00:312
2575299491,44cyclictest27329-21cron19:15:152
2575299491,38cyclictest0-21swapper/219:22:192
2575199497,9cyclictest7850irq/56-dwc_otg_23:35:271
2575199497,27cyclictest0-21swapper/120:40:291
25749994931,4cyclictest29390-21sh22:17:460
25749994929,4cyclictest4208-21diskmemload22:10:380
2574999491,32cyclictest15215-21aten_rbpower_vo20:10:320
25753994814,20cyclictest0-21swapper/321:27:373
2575299481,6cyclictest0-21swapper/220:50:272
2575299481,43cyclictest15332-21fschecks_count20:10:342
2575199487,26cyclictest0-21swapper/119:45:221
25751994815,11cyclictest30153-21/usr/sbin/munin21:40:251
2575199481,19cyclictest7850irq/56-dwc_otg_19:25:331
2574999486,26cyclictest0-21swapper/020:15:280
25749994825,12cyclictest21979-21ssh22:09:220
25749994810,16cyclictest0-21swapper/020:55:300
2575399473,13cyclictest11035-21sh22:35:263
25753994718,18cyclictest31007-21taskset20:54:003
2575199474,5cyclictest0-21swapper/100:35:261
2575199472,5cyclictest24370-21cut20:35:321
25749994720,17cyclictest7850irq/56-dwc_otg_00:26:330
25753994622,20cyclictest1907-21unixbench_singl00:20:463
25753994622,11cyclictest4173-21awk19:40:263
25753994616,18cyclictest2018-21runrttasks21:01:593
25753994613,10cyclictest0-21swapper/300:00:393
2575199468,25cyclictest0-21swapper/120:25:301
2575199467,25cyclictest0-21swapper/119:40:291
2574999462,8cyclictest4434-21grep19:40:320
25749994624,5cyclictest0-21swapper/019:20:420
25753994519,11cyclictest29053-21taskset19:19:103
25753994516,13cyclictest975-21if_wlan019:30:333
2574999459,21cyclictest0-21swapper/023:40:350
254672452,36sleep00-21swapper/019:10:060
25753994434,8cyclictest29957-21ls19:20:363
25753994419,13cyclictest326372sleep320:56:473
25753994414,20cyclictest0-21swapper/320:17:483
2575199447,25cyclictest0-21swapper/120:45:291
25751994413,22cyclictest23-21ksoftirqd/122:45:271
25753994315,9cyclictest7950irq/56-dwc_otg_20:09:253
2575199437,26cyclictest0-21swapper/120:20:291
2575199437,26cyclictest0-21swapper/120:20:291
25751994314,9cyclictest0-21swapper/123:05:391
25749994319,14cyclictest25861-21wget19:10:280
25753994218,10cyclictest7586-21taskset19:49:493
25753994216,17cyclictest27235-21chrt19:14:033
2575199428,24cyclictest0-21swapper/119:20:291
2575199426,5cyclictest7950irq/56-dwc_otg_22:05:161
25751994219,10cyclictest7750irq/56-dwc_otg23:15:251
25751994219,10cyclictest7750irq/56-dwc_otg23:15:251
2575199416,22cyclictest0-21swapper/120:10:291
2575199411,18cyclictest0-21swapper/123:34:461
25753994024,13cyclictest26642-21ntp_states20:40:383
25751994015,7cyclictest509-21cron23:15:161
25753993918,9cyclictest0-21swapper/320:34:083
2575199399,16cyclictest7950irq/56-dwc_otg_22:40:151
2575199398,14cyclictest0-21swapper/100:05:021
2575199392,29cyclictest7950irq/56-dwc_otg_20:15:251
25751993910,4cyclictest0-21swapper/122:10:401
2575199377,20cyclictest13155-21ssh21:20:291
25751993719,5cyclictest18662-21/usr/sbin/munin22:05:451
2575199371,6cyclictest7421-21ssh22:30:371
25751993716,13cyclictest0-21swapper/100:20:161
25751993710,7cyclictest4208-21diskmemload23:51:561
2575199366,5cyclictest7750irq/56-dwc_otg21:20:161
2575199362,10cyclictest634-21cut19:30:281
25751993617,4cyclictest20241-21sh21:28:231
2575199359,11cyclictest0-21swapper/121:05:261
2575199358,9cyclictest25748-21cyclictest21:14:021
25751993516,7cyclictest614-21tr00:20:281
34692340,2sleep10-21swapper/121:46:001
2575199349,5cyclictest7850irq/56-dwc_otg_21:35:151
2575199349,12cyclictest0-21swapper/119:55:281
25751993426,6cyclictest20644-21rm00:05:261
25751993416,10cyclictest9516-21ssh21:54:161
2575199339,4cyclictest0-21swapper/121:36:471
2575199338,13cyclictest7950irq/56-dwc_otg_21:55:411
2575199338,13cyclictest7950irq/56-dwc_otg_21:55:411
2575199332,7cyclictest7850irq/56-dwc_otg_19:35:291
25751993316,6cyclictest0-21swapper/123:45:311
25751993316,6cyclictest0-21swapper/123:45:311
2575199331,21cyclictest27302-21uniq22:15:321
25751993311,19cyclictest23-21ksoftirqd/122:25:271
25751993311,19cyclictest23-21ksoftirqd/122:25:271
25751993310,5cyclictest27793-21df22:55:301
25751993310,5cyclictest27793-21df22:55:301
2575199325,6cyclictest7750irq/56-dwc_otg19:10:411
2575199323,5cyclictest7750irq/56-dwc_otg21:00:411
2575199317,4cyclictest7750irq/56-dwc_otg00:25:451
2575199314,6cyclictest23422-21ssh22:50:271
2575199293,2cyclictest0-21swapper/120:55:261
254382274,15sleep30-21swapper/319:09:453
252342273,15sleep20-21swapper/219:07:092
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional