You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 11:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Tue Jun 02, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1395621600,1sleep30-21swapper/323:10:353
402421160,2sleep30-21swapper/300:16:383
1588321060,2sleep20-21swapper/219:55:242
3144899951,35cyclictest1450-21fschecks_count20:45:260
11632950,5sleep03144899cyclictest23:35:080
299172940,3sleep229-21rcuc/221:32:382
224962940,2sleep122498-21if_err_eth000:00:261
224962940,2sleep122498-21if_err_eth000:00:261
31454999211,56cyclictest0-21swapper/119:20:201
31454999211,56cyclictest0-21swapper/119:20:201
3144899898,28cyclictest0-21swapper/023:05:190
170642890,2sleep00-21swapper/022:35:290
141092850,6sleep33146599cyclictest23:50:253
57282830,2sleep20-21swapper/200:19:432
3144899832,6cyclictest0-21swapper/023:10:350
31448997916,6cyclictest20208-21ssh22:00:250
31448997916,6cyclictest20208-21ssh22:00:250
26502790,5sleep13145499cyclictest00:15:271
216772780,5sleep23146199cyclictest20:10:302
58862750,1sleep30-21swapper/322:21:393
31448997524,4cyclictest7950irq/56-dwc_otg_21:10:210
3144899751,23cyclictest14072-21fschecks_time19:50:250
3145499742,28cyclictest0-21swapper/119:10:211
3144899742,22cyclictest1888-21ssh22:16:550
3144899731,7cyclictest8958-21taskset22:25:330
3144899731,7cyclictest8958-21taskset22:25:330
3144899731,27cyclictest0-21swapper/000:39:060
122532730,5sleep23146199cyclictest00:26:192
122532730,5sleep23146199cyclictest00:26:192
3144899718,15cyclictest0-21swapper/021:05:080
3144899714,43cyclictest0-21swapper/021:45:190
304772710,2sleep20-21swapper/223:30:312
31448997020,11cyclictest0-21swapper/021:23:330
3144899691,20cyclictest8050irq/56-dwc_otg_23:55:290
31448996721,11cyclictest0-21swapper/021:29:440
306702660,3sleep330668-21ssh00:10:263
28942660,2sleep20-21swapper/222:18:442
3146599656,14cyclictest7850irq/56-dwc_otg20:20:183
3145499652,11cyclictest0-21swapper/120:40:221
3144899657,20cyclictest9-21ksoftirqd/023:03:550
31461996413,41cyclictest9981-21diskmemload22:14:182
177942630,2sleep10-21swapper/120:00:271
31448996228,5cyclictest8050irq/56-dwc_otg_21:50:200
3145499617,38cyclictest0-21swapper/100:10:221
31454996122,9cyclictest29680-21ssh23:30:181
31454996119,24cyclictest13361-21/usr/sbin/munin23:10:271
3144899611,40cyclictest31644-21aten_rbpower_po19:10:220
3146199607,3cyclictest0-21swapper/222:34:112
3146199606,3cyclictest0-21swapper/223:38:452
31461996012,4cyclictest29977-21unixbench-2d22:50:362
3146199601,12cyclictest23582-21awk20:15:322
3146199601,11cyclictest8050irq/56-dwc_otg_22:03:302
3146199601,11cyclictest8050irq/56-dwc_otg_22:03:302
3145499605,23cyclictest8050irq/56-dwc_otg_23:15:141
3145499605,23cyclictest8050irq/56-dwc_otg_23:15:141
3146199592,11cyclictest7950irq/56-dwc_otg_22:25:332
3146199592,11cyclictest7950irq/56-dwc_otg_22:25:332
3146199591,13cyclictest833-21sed19:15:072
3144899593,10cyclictest0-21swapper/019:40:290
286662590,2sleep10-21swapper/122:10:261
3146199583,15cyclictest9962-21kworker/u8:321:10:222
3146199581,5cyclictest15084-21sed23:50:362
31461995815,40cyclictest24368-21latency_hist22:45:072
3146199581,13cyclictest0-21swapper/200:36:182
31448995836,5cyclictest8050irq/56-dwc_otg_22:20:330
31448995828,5cyclictest7950irq/56-dwc_otg_20:30:360
3144899581,6cyclictest25874-21idleruntime-cro00:05:080
3144899581,6cyclictest25874-21idleruntime-cro00:05:080
3146199576,41cyclictest7950irq/56-dwc_otg_21:15:512
3146199575,10cyclictest7950irq/56-dwc_otg_20:45:252
3146199572,46cyclictest0-21swapper/221:54:462
3146199571,48cyclictest0-21swapper/223:25:082
3146199571,47cyclictest0-21swapper/223:03:122
3144899576,48cyclictest0-21swapper/019:15:190
3144899572,28cyclictest0-21swapper/022:45:080
3144899571,6cyclictest13482-21ssh22:30:360
31448995710,27cyclictest27971-21latency_hist22:10:070
228042570,2sleep30-21swapper/322:42:213
3146199564,8cyclictest8050irq/56-dwc_otg_21:24:322
3146199564,10cyclictest25749-21fschecks_count23:25:252
3146199563,46cyclictest7950irq/56-dwc_otg_23:05:352
3146199563,15cyclictest7950irq/56-dwc_otg_21:39:042
3146199563,14cyclictest7950irq/56-dwc_otg_00:00:032
3146199562,5cyclictest15859-21unixbench-2d00:30:362
3146199562,5cyclictest0-21swapper/221:05:272
3146199561,4cyclictest31042-21ls00:10:302
31454995614,21cyclictest23262-21sh23:21:441
31448995628,7cyclictest15778-21aten_rbpower_cu21:55:210
31448995612,28cyclictest9507-21grep19:35:360
3146199555,42cyclictest0-21swapper/222:05:342
3146199552,5cyclictest0-21swapper/200:05:352
3146199551,4cyclictest1165-21snmpd00:22:182
3146199551,47cyclictest0-21swapper/222:59:392
3146199551,11cyclictest7950irq/56-dwc_otg_23:47:482
31448995520,17cyclictest10326-21missed_timers23:45:310
31448995517,35cyclictest7427-21/usr/sbin/munin00:20:340
3144899551,25cyclictest29184-21ssh22:10:330
31448995512,26cyclictest101ktimersoftd/021:05:220
31448995511,26cyclictest9333-21latency_hist23:45:070
3146199545,4cyclictest0-21swapper/223:16:542
3146199545,4cyclictest0-21swapper/223:16:542
3146199541,6cyclictest14039-21ls23:10:362
31461995415,4cyclictest23391-21taskset00:00:382
31461995415,4cyclictest23391-21taskset00:00:382
3146199541,3cyclictest0-21swapper/219:50:282
31461995412,4cyclictest31609-21latency_hist20:40:072
3145499549,13cyclictest30016-21ssh00:10:071
31454995418,23cyclictest10897-21ssh22:28:151
31454995418,23cyclictest10897-21ssh22:28:151
31454995411,13cyclictest15424-21ntpq00:30:301
31448995412,28cyclictest0-21swapper/000:17:100
3144899541,20cyclictest29502-21ls23:30:080
3146199535,7cyclictest7850irq/56-dwc_otg23:44:572
3146199533,10cyclictest7950irq/56-dwc_otg_19:22:592
3146199533,10cyclictest7950irq/56-dwc_otg_19:22:592
3146199532,11cyclictest0-21swapper/222:45:322
31461995318,32cyclictest5209-21interrupts19:25:252
3146199531,7cyclictest3351-21ssh21:40:212
3146199531,10cyclictest8050irq/56-dwc_otg_21:57:332
31454995320,15cyclictest22441-21ssh21:24:221
31454995314,25cyclictest9774-21ssh00:24:221
31454995313,26cyclictest25457-21rm21:27:131
3144899539,21cyclictest0-21swapper/000:30:320
3144899532,7cyclictest24369-21munin-run20:20:070
3144899532,30cyclictest0-21swapper/023:50:200
3144899531,28cyclictest2988-21/usr/sbin/munin20:50:240
3144899531,28cyclictest2988-21/usr/sbin/munin20:50:240
3146199522,9cyclictest1633-1kworker/u9:022:20:122
3146199521,6cyclictest8125-21taskset21:04:462
3146199521,5cyclictest10725-21ssh21:49:102
3146199521,5cyclictest0-21swapper/220:59:142
3146199521,4cyclictest0-21swapper/220:40:362
31461995212,36cyclictest0-21swapper/219:30:212
3145499526,12cyclictest14718-21ssh23:50:331
31454995221,9cyclictest14677-21ls19:50:341
31448995227,4cyclictest14728-21ssh21:15:230
3144899521,6cyclictest2137-21ssh23:35:300
3146199515,3cyclictest8050irq/56-dwc_otg_21:25:312
3146199511,9cyclictest98712sleep219:39:472
3145499514,8cyclictest7850irq/56-dwc_otg20:50:191
3145499514,8cyclictest7850irq/56-dwc_otg20:50:191
31454995120,16cyclictest32241-21ls21:35:281
31454995118,19cyclictest21765-21ssh00:38:371
31448995113,21cyclictest4904-21aten_rbpower_vo20:55:240
3146599502,8cyclictest7950irq/56-dwc_otg_19:55:203
3146199505,9cyclictest0-21swapper/220:01:482
3146199502,9cyclictest18364-21ssh22:36:472
3146199502,3cyclictest0-21swapper/219:17:402
31454995022,20cyclictest27976-21sh23:27:491
31454995017,12cyclictest21169-21users22:00:361
31454995017,12cyclictest21169-21users22:00:361
31454995014,17cyclictest9981-21diskmemload23:02:001
31454995013,25cyclictest2435-21chrt22:56:441
31454995010,11cyclictest22544-21apt20:15:071
3144899502,8cyclictest0-21swapper/023:20:190
3144899502,35cyclictest11219-21missed_timers00:25:290
3144899502,35cyclictest11219-21missed_timers00:25:290
31448995020,4cyclictest8050irq/56-dwc_otg_21:40:180
3144899501,27cyclictest6312-21apt19:30:070
3146599497,7cyclictest8050irq/56-dwc_otg_23:45:203
31461994917,29cyclictest25294-21seq20:20:302
3146199491,5cyclictest295142sleep220:32:002
3145499497,14cyclictest5707-21wc19:25:331
3145499494,9cyclictest7950irq/56-dwc_otg_23:55:201
31454994920,10cyclictest11342-21/usr/sbin/munin21:10:331
31454994913,22cyclictest30369-21ssh22:51:031
31454994912,22cyclictest9338-21ssh21:46:391
3144899499,26cyclictest13-21rcuc/022:50:140
31448994932,7cyclictest9783-21kworker/0:119:55:240
3146599482,12cyclictest7950irq/56-dwc_otg_22:00:193
3146599482,12cyclictest7950irq/56-dwc_otg_22:00:193
3145499486,27cyclictest13797-21chrt21:52:141
31454994817,19cyclictest18265-21ssh22:36:371
3144899484,35cyclictest0-21swapper/019:30:180
31448994823,5cyclictest7950irq/56-dwc_otg_22:55:220
31448994815,16cyclictest26337-21sh22:46:150
3146599473,12cyclictest0-21swapper/321:00:193
3146599472,7cyclictest8050irq/56-dwc_otg_19:30:183
3146199472,9cyclictest0-21swapper/219:40:362
3145499479,15cyclictest17643-21ssh21:18:261
3145499479,15cyclictest10065-21dpkg21:10:071
3145499477,23cyclictest7850irq/56-dwc_otg23:39:091
31454994718,18cyclictest15357-21ssh22:33:511
31454994714,25cyclictest7336-21rm23:41:291
31454994712,14cyclictest29776-21rm21:32:231
3144899472,7cyclictest0-21swapper/020:35:300
31448994725,12cyclictest0-21swapper/021:37:290
3144899472,25cyclictest0-21swapper/020:25:320
3144899471,24cyclictest22124-21unixbench_singl20:10:350
3146599467,18cyclictest0-21swapper/300:35:203
3146199461,9cyclictest0-21swapper/220:26:102
3146199461,7cyclictest7950irq/56-dwc_otg_20:50:572
3146199461,7cyclictest7950irq/56-dwc_otg_20:50:572
3146199461,4cyclictest11968-21apt-get19:45:222
3145499469,14cyclictest7850irq/56-dwc_otg22:45:261
3145499467,24cyclictest0-21swapper/120:20:211
31454994626,17cyclictest15572-21apt-get19:55:181
31454994622,6cyclictest2613-21idleruntime-cro19:20:071
31454994621,12cyclictest2241-21date20:45:361
31454994617,16cyclictest18030-21ssh21:57:241
31454994613,12cyclictest7950irq/56-dwc_otg_22:42:181
31448994625,5cyclictest7850irq/56-dwc_otg21:30:230
31448994624,4cyclictest0-21swapper/023:15:140
31448994624,4cyclictest0-21swapper/023:15:140
3144899461,27cyclictest12486-21cat19:45:290
3146599454,10cyclictest24018-21sh22:05:193
31454994512,17cyclictest11343-21ssh23:07:551
31454994511,12cyclictest14338-21munin-plugin-st00:30:081
31454994511,12cyclictest14338-21munin-plugin-st00:30:081
31454994510,14cyclictest4642-21/usr/sbin/munin21:40:361
31448994529,4cyclictest30181-21ls00:10:080
3144899452,23cyclictest32351-21cat20:40:290
187952450,2sleep30-21swapper/322:37:343
3146599441,7cyclictest29706-21ssh23:30:213
3145499447,25cyclictest0-21swapper/120:35:211
3145499447,19cyclictest7850irq/56-dwc_otg22:05:231
31454994417,8cyclictest23002-21diskstats20:15:241
31454994416,15cyclictest3902-21rm22:20:091
31454994415,12cyclictest1947-21ssh22:17:021
3144899446,26cyclictest0-21swapper/020:00:210
3144899446,19cyclictest0-21swapper/020:20:200
31448994422,9cyclictest0-21swapper/019:20:170
31448994422,9cyclictest0-21swapper/019:20:170
3144899442,25cyclictest19164-21acpi20:05:170
3144899442,25cyclictest19164-21acpi20:05:170
309592442,14sleep00-21swapper/019:07:400
3145499437,11cyclictest7950irq/56-dwc_otg_23:45:391
3144899432,26cyclictest594-21ssh00:13:080
3146199421,6cyclictest0-21swapper/220:10:072
3146199421,6cyclictest0-21swapper/220:10:072
31454994211,12cyclictest9863-21seq19:39:411
3146599415,15cyclictest8050irq/56-dwc_otg_23:55:233
31454994112,13cyclictest29475-21runrttasks20:31:291
3146599405,11cyclictest7950irq/56-dwc_otg_20:55:213
31465994021,4cyclictest3658-21fschecks_time21:40:253
31454994014,15cyclictest7927-21chrt21:02:141
5032390,2sleep30-21swapper/322:55:213
3146599398,14cyclictest8050irq/56-dwc_otg_19:50:363
3146599392,6cyclictest28519-21cut22:10:243
3146599392,34cyclictest0-21swapper/319:10:133
31465993916,16cyclictest8050irq/56-dwc_otg_00:20:133
3146599388,18cyclictest11-21rcu_preempt23:15:203
3146599388,18cyclictest11-21rcu_preempt23:15:203
31465993827,8cyclictest22054-21rm00:00:183
31465993827,8cyclictest22054-21rm00:00:183
31465993811,4cyclictest21298-21acpi23:20:173
31454993811,14cyclictest0-21swapper/120:05:201
31454993811,14cyclictest0-21swapper/120:05:201
31454993810,12cyclictest11907-21latency_hist19:45:081
3146599377,24cyclictest0-21swapper/323:00:203
3146599374,22cyclictest7850irq/56-dwc_otg21:15:263
3146599374,20cyclictest0-21swapper/321:45:313
31465993716,5cyclictest9461-21sh22:25:383
31465993716,5cyclictest9461-21sh22:25:383
3145499378,13cyclictest7779-21taskset19:31:031
3145499377,9cyclictest0-21swapper/119:47:341
31454993714,13cyclictest31177-21latency_hist19:10:081
114742370,2sleep30-21swapper/323:08:093
101202370,5sleep33146599cyclictest19:40:083
3146599367,24cyclictest0-21swapper/319:45:223
3146599365,15cyclictest8050irq/56-dwc_otg_19:25:073
3146599365,15cyclictest8050irq/56-dwc_otg_19:25:073
3146599364,6cyclictest0-21swapper/322:30:203
3145499366,10cyclictest0-21swapper/120:26:051
31465993514,12cyclictest28652-21latency_hist22:50:083
3146599346,6cyclictest0-21swapper/321:20:353
3146599345,5cyclictest7850irq/56-dwc_otg19:15:273
3146599343,14cyclictest8050irq/56-dwc_otg_22:20:083
31465993411,4cyclictest0-21swapper/300:30:293
3146599337,15cyclictest0-21swapper/319:40:213
3146599334,6cyclictest7850irq/56-dwc_otg21:55:263
3145499333,10cyclictest7950irq/56-dwc_otg_20:59:111
3146599329,5cyclictest8050irq/56-dwc_otg_20:35:073
3146599328,4cyclictest8050irq/56-dwc_otg_21:30:333
3146599328,12cyclictest0-21swapper/322:50:333
3146599326,6cyclictest7850irq/56-dwc_otg19:25:203
3146599326,5cyclictest8050irq/56-dwc_otg_21:35:263
3146599325,15cyclictest7950irq/56-dwc_otg_23:25:223
3146599324,6cyclictest8050irq/56-dwc_otg_20:45:363
3146599323,12cyclictest8050irq/56-dwc_otg_21:25:273
31465993224,6cyclictest31146-21sed20:35:363
3146599321,21cyclictest21569-21missed_timers20:10:283
31465993210,10cyclictest8050irq/56-dwc_otg_00:05:273
3146599315,5cyclictest8050irq/56-dwc_otg_20:50:343
3146599315,5cyclictest8050irq/56-dwc_otg_20:50:343
3146599313,6cyclictest7850irq/56-dwc_otg21:10:283
3146599313,10cyclictest8050irq/56-dwc_otg_00:25:213
3146599313,10cyclictest8050irq/56-dwc_otg_00:25:213
3146599311,18cyclictest5855-21uniq23:40:243
310322316,17sleep30-21swapper/319:08:323
21932310,3sleep32187-21ntp_states23:35:313
3146599301,3cyclictest7850irq/56-dwc_otg21:50:263
3146599299,9cyclictest8050irq/56-dwc_otg_20:00:273
3146599291,24cyclictest9420-21timerwakeupswit21:05:363
3146599282,5cyclictest27530-21sed20:25:323
31465992822,4cyclictest24368-21idleruntime-cro20:20:073
3146599262,5cyclictest511-21unixbench_singl20:40:373
3146599261,13cyclictest0-21swapper/320:05:353
3146599261,13cyclictest0-21swapper/320:05:353
308292263,13sleep20-21swapper/219:06:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional