You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 07:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Dec 06, 2025 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3060821700,2sleep21419099cyclictest00:07:532
3086621450,1sleep10-21swapper/100:08:281
2972521160,2sleep00-21swapper/023:23:140
1418899911,79cyclictest2128-21unixbench-2d21:20:420
1418899871,5cyclictest31980-21taskset00:10:250
14188998534,41cyclictest7850irq/56-dwc_otg_00:20:130
14189998320,57cyclictest14192-21taskset19:10:161
1418899831,4cyclictest29802-21grep21:15:320
194402810,2sleep30-21swapper/323:52:483
1418899812,72cyclictest0-21swapper/019:10:150
1418899791,61cyclictest22500-21aten_rbpower_vo22:30:280
1418899791,5cyclictest8489-21head20:20:420
1418899791,5cyclictest27799-21wc19:45:400
1418899781,64cyclictest4699-21ssh23:33:170
1418899773,61cyclictest25283-21diskmemload22:07:170
1418899772,70cyclictest0-21swapper/021:40:260
58692760,2sleep10-21swapper/122:07:471
1418899761,62cyclictest11283-21ssh21:33:100
1418899761,59cyclictest18652-21ssh00:37:030
14188997610,51cyclictest25270-21sh21:10:130
1418899753,62cyclictest23338-21apt-get19:35:250
1418899751,6cyclictest28112-21apt00:05:140
1418899751,4cyclictest14903-21taskset21:37:370
1418899751,3cyclictest7950irq/56-dwc_otg_22:28:200
1418899751,3cyclictest7950irq/56-dwc_otg_22:28:200
1419199742,56cyclictest7950irq/56-dwc_otg_19:10:163
1418899742,4cyclictest0-21swapper/023:25:370
1418899741,63cyclictest0-21swapper/021:54:380
1418899741,62cyclictest9042-21df22:55:300
1418899741,55cyclictest16447-21aten_rbpower_en20:45:250
1418899731,6cyclictest0-21swapper/023:45:280
1418899731,64cyclictest25828-21cpuspeed21:10:290
1418899731,59cyclictest0-21swapper/022:11:200
1418899731,4cyclictest12142-21/usr/sbin/munin22:15:440
1418899731,4cyclictest0-21swapper/000:24:170
1418899727,50cyclictest0-21swapper/021:46:470
1418899721,5cyclictest17809-21sh23:06:340
1418899721,4cyclictest13523-21latency_hist00:30:140
38142710,1sleep20-21swapper/221:23:512
165952710,2sleep216594-21irqstats23:05:332
1418899712,4cyclictest0-21swapper/019:40:400
1418899712,48cyclictest1035-21rm22:00:540
1418899711,4cyclictest5527-21/usr/sbin/munin20:15:410
1418899711,3cyclictest0-21swapper/022:50:140
244182700,3sleep224411-21ssh23:15:392
1418899701,61cyclictest0-21swapper/023:00:240
1418899701,60cyclictest0-21swapper/000:05:370
1418899701,52cyclictest7737-21ssh23:36:480
1418899701,52cyclictest7737-21ssh23:36:480
1418899701,4cyclictest18596-21runrttasks23:51:000
1418899701,4cyclictest0-21swapper/022:53:030
162072690,5sleep31419199cyclictest19:15:283
1418899698,49cyclictest0-21swapper/022:22:300
1418899691,5cyclictest0-21swapper/023:14:560
1418899691,5cyclictest0-21swapper/022:38:440
1418899691,57cyclictest0-21swapper/022:00:140
1418899691,57cyclictest0-21swapper/022:00:140
1419099684,7cyclictest7850irq/56-dwc_otg_20:45:322
1418999683,4cyclictest7950irq/56-dwc_otg_00:10:331
1418899681,6cyclictest14447-21latency_hist20:40:130
1418899681,5cyclictest31798-21sshd22:41:520
1418899681,5cyclictest31798-21sshd22:41:520
1418899681,58cyclictest0-21swapper/021:25:360
1418899681,58cyclictest0-21swapper/021:25:360
1419199676,50cyclictest5799-21cut20:15:313
1418899677,45cyclictest7750irq/56-dwc_otg23:57:000
1418899676,55cyclictest0-21swapper/020:50:180
1418899671,5cyclictest15644-21ssh00:32:330
1418899671,5cyclictest15644-21ssh00:32:330
1418899671,5cyclictest0-21swapper/021:04:330
1418899671,51cyclictest19093-21taskset19:21:390
14191996618,28cyclictest9074-21sh22:11:213
1419199661,43cyclictest0-21swapper/300:35:253
1419199651,43cyclictest30286-21/usr/sbin/munin21:15:393
1419099658,10cyclictest7950irq/56-dwc_otg_22:55:372
1418899651,5cyclictest0-21swapper/020:28:590
1418899651,5cyclictest0-21swapper/020:28:590
1418899651,53cyclictest23546-21ssh23:15:190
1418899651,51cyclictest12237-21sshd20:31:450
1418899651,4cyclictest29821-21unixbench-2d19:50:410
1418899651,4cyclictest21226-21runrttasks19:29:370
1418899651,4cyclictest0-21swapper/023:40:160
1419199641,36cyclictest25982-21ssh21:51:243
1418999648,5cyclictest7850irq/56-dwc_otg_22:16:281
1418999643,5cyclictest7850irq/56-dwc_otg_21:40:291
1418999642,5cyclictest13764-21/usr/sbin/munin23:45:341
1418899642,5cyclictest0-21swapper/020:12:400
1419199631,35cyclictest21824-21ssh23:12:083
1419099636,5cyclictest7950irq/56-dwc_otg_20:15:312
1418999637,43cyclictest30784-21ssh21:15:441
1418999631,46cyclictest25963-21fschecks_time21:10:311
1418899638,42cyclictest31817-21chrt19:56:350
1418899631,4cyclictest16250-21latency_hist20:45:140
1418999621,8cyclictest7783-21ssh00:20:361
1418899621,6cyclictest0-21swapper/019:34:570
1419099616,5cyclictest0-21swapper/221:40:332
1419099613,5cyclictest7750irq/56-dwc_otg21:10:142
1418999615,5cyclictest7850irq/56-dwc_otg_20:15:281
1418999613,46cyclictest25407-21ssh21:10:141
14189996110,36cyclictest29112-1kworker/u9:023:34:001
1418899616,40cyclictest0-21swapper/020:07:420
14188996117,31cyclictest7850irq/56-dwc_otg_20:05:000
1418899611,4cyclictest17242-21taskset19:16:170
1419199603,43cyclictest27605-21ssh22:36:053
1419199601,42cyclictest0-21swapper/321:40:463
1419199601,39cyclictest28679-21taskset23:20:523
1418999605,4cyclictest7850irq/56-dwc_otg_21:38:061
1418999601,45cyclictest0-21swapper/121:51:541
1418999601,10cyclictest7750irq/56-dwc_otg21:45:311
14189996010,39cyclictest7850irq/56-dwc_otg_19:40:501
1419199591,44cyclictest21105-21ssh22:28:033
1419199591,44cyclictest21105-21ssh22:28:033
1419199591,33cyclictest7785-21ntp_states00:20:363
1419099598,11cyclictest0-21swapper/222:40:092
1419099596,4cyclictest23573-21cut19:35:312
14190995910,4cyclictest0-21swapper/221:19:072
1418999598,35cyclictest0-21swapper/122:39:521
1419199583,48cyclictest21877-21taskset21:45:593
1419199581,46cyclictest22755-21/usr/sbin/munin22:30:323
1419199581,38cyclictest3523-21apt-get22:05:273
1419199581,37cyclictest0-21swapper/320:45:223
1419099589,5cyclictest7950irq/56-dwc_otg_23:10:442
1419099581,7cyclictest25557-21if_eth019:40:322
1418999582,5cyclictest16951-21ssh00:35:271
1418999582,5cyclictest0-21swapper/123:23:411
1418899581,46cyclictest0-21swapper/020:59:270
1418899581,46cyclictest0-21swapper/020:59:270
1419199571,46cyclictest6798-21ssh21:27:023
1419199571,46cyclictest6798-21ssh21:27:023
1419199571,45cyclictest0-21swapper/319:30:033
1419199571,41cyclictest0-21swapper/322:55:333
1419199571,41cyclictest0-21swapper/321:59:523
1419199571,41cyclictest0-21swapper/321:59:523
1419099578,4cyclictest7750irq/56-dwc_otg21:55:332
1419099578,4cyclictest7750irq/56-dwc_otg21:55:332
1419099576,6cyclictest7950irq/56-dwc_otg_23:20:402
1418999577,35cyclictest0-21swapper/123:18:021
1418999576,42cyclictest23386-21ls23:15:131
1418999575,4cyclictest0-21swapper/123:25:301
1418999571,5cyclictest23687-21ssh23:58:511
1418999571,12cyclictest11306-21ssh22:58:221
123042570,5sleep21419099cyclictest23:43:502
1419199561,45cyclictest0-21swapper/319:43:083
1419199561,44cyclictest0-21swapper/300:16:023
1419199561,43cyclictest23968-21ssh23:59:253
1419199561,43cyclictest13016-21ssh22:16:383
1419199561,40cyclictest12160-21ssh21:34:563
1419199561,38cyclictest2633-21ssh21:21:273
1419199561,38cyclictest13498-21date00:30:143
1419199561,36cyclictest31790-21ssh22:41:513
1419199561,36cyclictest31790-21ssh22:41:513
1418999569,4cyclictest7850irq/56-dwc_otg_19:46:131
1418999566,4cyclictest0-21swapper/100:29:251
1418999564,4cyclictest7750irq/56-dwc_otg20:45:271
1418999564,42cyclictest267192sleep100:02:121
1418999562,3cyclictest7750irq/56-dwc_otg22:30:241
1418999561,8cyclictest174842sleep119:19:041
19082550,2sleep2301ktimersoftd/200:13:042
1419199553,37cyclictest0-21swapper/319:56:373
1419199551,37cyclictest0-21swapper/323:32:003
1419199551,35cyclictest1917-21rm22:02:403
1419199551,33cyclictest28742-21/usr/sbin/munin19:50:303
1419099558,4cyclictest0-21swapper/223:33:332
1418999557,4cyclictest0-21swapper/122:26:381
1418999557,4cyclictest0-21swapper/122:26:381
1418999552,7cyclictest7460-21ssh22:10:271
14189995510,31cyclictest7850irq/56-dwc_otg_21:58:461
14189995510,31cyclictest7850irq/56-dwc_otg_21:58:461
14189995510,31cyclictest0-21swapper/121:21:431
1419199547,30cyclictest0-21swapper/321:10:223
1419199545,38cyclictest9225-21rm23:40:013
1419199545,38cyclictest9225-21rm23:40:013
1419199542,38cyclictest0-21swapper/300:33:023
1419199542,38cyclictest0-21swapper/300:33:023
1419199541,43cyclictest13567-21ssh23:45:323
1419199541,41cyclictest0-21swapper/319:35:263
1419199541,35cyclictest18424-21ssh22:25:143
1419199541,35cyclictest15306-21ssh21:38:263
1419199541,33cyclictest28143-21runrttasks19:45:473
1419099546,4cyclictest0-21swapper/200:29:322
1418999544,8cyclictest7750irq/56-dwc_otg23:09:291
1418999544,4cyclictest7750irq/56-dwc_otg00:15:191
1418999542,10cyclictest199762sleep123:53:551
1418999541,8cyclictest7521-21chrt22:53:081
1418999541,7cyclictest0-21swapper/122:49:581
1419199534,36cyclictest32265-21fschecks_count00:10:313
1419199531,38cyclictest31985-21/usr/sbin/munin23:25:483
1419199531,34cyclictest9606-21ssh23:40:183
1419199531,34cyclictest23567-21ssh23:15:213
1419199531,32cyclictest0-21swapper/323:09:463
1418999536,4cyclictest0-21swapper/123:36:181
1418999536,4cyclictest0-21swapper/123:36:181
1418999531,5cyclictest15802-21ssh00:33:021
1418999531,5cyclictest15802-21ssh00:33:021
1418999531,42cyclictest0-21swapper/119:35:251
1419199521,42cyclictest15313-21ssh23:04:133
1419199521,41cyclictest5004-21chrt20:13:043
1419199521,40cyclictest19524-21chrt20:51:123
1419199521,39cyclictest8584-21runrttasks20:21:103
1419199521,34cyclictest0-21swapper/321:04:373
1419099526,10cyclictest7850irq/56-dwc_otg_21:37:472
1418999523,7cyclictest18588-21latency_hist22:25:141
1418999521,9cyclictest10990-21ssh21:32:361
1418999521,6cyclictest31676-21chrt22:41:361
1418999521,6cyclictest31676-21chrt22:41:361
1419199511,46cyclictest1476-21apt-get20:05:203
1419199511,37cyclictest3296-21ssh22:47:103
1418999518,3cyclictest7850irq/56-dwc_otg_20:59:311
1418999518,3cyclictest7850irq/56-dwc_otg_20:59:311
1418999511,8cyclictest7950irq/56-dwc_otg_23:04:161
1418999511,5cyclictest1170-21ssh22:01:091
1418999511,3cyclictest0-21swapper/120:50:371
14189995111,36cyclictest13912-21head20:35:411
1419199501,40cyclictest26856-21chrt00:02:313
1419199501,39cyclictest25063-21taskset21:07:453
1419199501,39cyclictest10405-21seq20:26:173
1419199501,39cyclictest10405-21seq20:26:173
1419099501,5cyclictest4822-21users22:05:432
14189995010,37cyclictest20717-21timerwakeupswit19:25:391
1419199495,32cyclictest0-21swapper/320:31:493
1419199492,32cyclictest0-21swapper/319:35:033
1419199491,38cyclictest0-21swapper/319:24:193
1419199491,35cyclictest7341-21ssh22:52:463
1419099497,9cyclictest7950irq/56-dwc_otg_20:50:282
1418999492,9cyclictest7850irq/56-dwc_otg_21:04:421
1418999491,41cyclictest0-21swapper/121:29:291
1418999491,41cyclictest0-21swapper/121:29:291
1419199485,33cyclictest14086-21chrt20:37:153
1419199481,34cyclictest0-21swapper/300:08:523
1419199481,31cyclictest0-21swapper/320:59:063
1419199481,31cyclictest0-21swapper/320:59:063
1419099483,10cyclictest7750irq/56-dwc_otg22:45:252
1418999484,7cyclictest7950irq/56-dwc_otg_20:23:371
1418999482,6cyclictest17885-21wget19:20:271
1418999482,3cyclictest0-21swapper/123:42:491
1418999481,7cyclictest5258-21dpkg20:15:131
1418999481,6cyclictest0-21swapper/120:40:201
1418999475,4cyclictest0-21swapper/120:05:401
1418999471,4cyclictest7850irq/56-dwc_otg_20:31:491
1419199462,32cyclictest15931-21chrt20:42:433
1419199461,35cyclictest14432chrt20:04:593
1418999462,8cyclictest29031-21fschecks_count19:50:311
1418999462,5cyclictest608-21ntp_states20:00:371
1418999461,6cyclictest10746-21modprobe20:30:141
1418999461,6cyclictest10746-21modprobe20:30:141
137312462,14sleep00-21swapper/019:07:560
1418999457,4cyclictest31654-21grep19:55:401
1418999441,3cyclictest0-21swapper/119:30:281
14190994016,10cyclictest28742-21/usr/sbin/munin19:50:412
14190993924,5cyclictest1120-21runrttasks21:05:142
1419099371,26cyclictest0-21swapper/219:45:412
14190993711,13cyclictest0-21swapper/221:31:482
1419099363,5cyclictest7850irq/56-dwc_otg_23:45:402
1419099362,11cyclictest7850irq/56-dwc_otg_21:52:312
139152366,15sleep30-21swapper/319:10:143
1419099358,6cyclictest0-21swapper/222:51:472
1419099357,7cyclictest7850irq/56-dwc_otg_23:50:382
1419099353,5cyclictest0-21swapper/223:25:272
1419099348,7cyclictest7750irq/56-dwc_otg00:15:322
1419099346,15cyclictest7750irq/56-dwc_otg23:55:362
14190993418,5cyclictest19399-21idleruntime-cro19:25:132
14190993413,11cyclictest6937-21ssh21:27:192
14190993413,11cyclictest6937-21ssh21:27:192
1419099337,15cyclictest7750irq/56-dwc_otg19:30:132
1419099336,5cyclictest7750irq/56-dwc_otg22:20:352
1419099334,6cyclictest23597-21unixbench_singl22:30:432
1419099333,11cyclictest7750irq/56-dwc_otg19:55:252
14190993317,5cyclictest8470-21sh23:38:212
14190993317,5cyclictest8470-21sh23:38:212
1419099331,13cyclictest0-21swapper/222:16:532
1419099331,10cyclictest30863-21ssh22:40:422
1419099331,10cyclictest30863-21ssh22:40:422
1419099329,5cyclictest7850irq/56-dwc_otg_20:05:172
1419099327,5cyclictest7950irq/56-dwc_otg_22:00:342
1419099326,5cyclictest7750irq/56-dwc_otg22:10:432
1419099324,11cyclictest7950irq/56-dwc_otg_00:00:442
14190993223,7cyclictest26384-21rm21:10:372
1419099321,3cyclictest7750irq/56-dwc_otg20:10:292
14190993212,4cyclictest7950irq/56-dwc_otg_22:25:352
14190993212,4cyclictest7950irq/56-dwc_otg_22:25:352
1419099317,14cyclictest31-21ksoftirqd/223:05:142
1419099315,12cyclictest7950irq/56-dwc_otg_21:45:312
1419099315,12cyclictest7950irq/56-dwc_otg_20:35:302
1419099313,24cyclictest7950irq/56-dwc_otg_20:55:262
1419099313,24cyclictest7950irq/56-dwc_otg_20:55:262
1419099311,4cyclictest0-21swapper/219:10:252
1419099311,3cyclictest7750irq/56-dwc_otg20:20:442
1419099311,15cyclictest7950irq/56-dwc_otg_20:30:362
1419099308,11cyclictest7950irq/56-dwc_otg_00:33:532
1419099308,11cyclictest7950irq/56-dwc_otg_00:33:532
1419099303,16cyclictest7950irq/56-dwc_otg_19:30:392
1419099302,13cyclictest7950irq/56-dwc_otg_00:35:212
1419099292,12cyclictest7750irq/56-dwc_otg00:20:342
131022296,10sleep10-21swapper/119:05:381
1419099282,12cyclictest7950irq/56-dwc_otg_20:00:282
1419099281,12cyclictest7850irq/56-dwc_otg_20:25:392
1419099281,12cyclictest7850irq/56-dwc_otg_20:25:392
1419099277,4cyclictest7950irq/56-dwc_otg_20:40:372
1419099262,4cyclictest7750irq/56-dwc_otg19:15:242
122242263,13sleep20-21swapper/219:05:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional