You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 09:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Fri Apr 24, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1937821050,2sleep10-21swapper/107:29:301
295462940,2sleep00-21swapper/007:01:550
131792920,1sleep00-21swapper/008:01:060
89412890,2sleep10-21swapper/106:38:091
2342299897,55cyclictest0-21swapper/009:11:010
242672870,5sleep02342299cyclictest04:31:130
130742860,2sleep20-21swapper/205:31:082
52202810,2sleep10-21swapper/107:11:191
76062800,5sleep12342399cyclictest09:51:181
99242770,2sleep00-21swapper/008:36:090
207912760,3sleep013-21rcuc/009:28:510
2342299741,55cyclictest0-21swapper/008:16:010
23423997321,22cyclictest0-21swapper/106:46:011
2342299737,23cyclictest0-21swapper/004:36:010
2342299721,30cyclictest0-21swapper/006:11:010
82682680,2sleep20-21swapper/209:13:352
2342599681,45cyclictest30801-21grep04:51:013
191432680,2sleep30-21swapper/307:29:043
2342599661,54cyclictest2005-21ssh07:46:513
2342599661,54cyclictest2005-21ssh07:46:513
2342599661,52cyclictest27059-21/usr/sbin/munin04:41:033
2342599661,51cyclictest9061-21apt-get05:21:003
2342599661,48cyclictest21617-21apt-get05:55:523
2342599661,44cyclictest16534-21rm08:44:373
2342599661,36cyclictest0-21swapper/306:51:003
2342599651,52cyclictest26524-21ssh07:37:293
2342599651,52cyclictest11831-21ssh09:17:343
2342599651,47cyclictest32744-21memory07:06:103
2342599651,43cyclictest13763-21ssh10:00:003
2342599651,40cyclictest327-21ssh08:25:123
2342599641,45cyclictest32714-21/usr/sbin/munin04:56:053
2342599641,44cyclictest7801-21ssh09:51:393
2342599641,44cyclictest10602-21ssh08:36:183
11702640,3sleep01159-21ntp_states07:46:120
11702640,3sleep01159-21ntp_states07:46:120
23425996317,44cyclictest29598-21if_eth006:16:063
23425996317,44cyclictest29598-21if_eth006:16:063
2342599631,45cyclictest3245-21ssh08:27:563
2342599631,43cyclictest7726-21ssh09:12:343
2342599631,41cyclictest15549-21ssh07:25:033
2342399631,29cyclictest0-21swapper/105:11:011
2342299634,6cyclictest0-21swapper/006:46:010
171952630,2sleep20-21swapper/209:24:502
23425996222,26cyclictest17847-21processes08:06:143
23425996222,26cyclictest17847-21processes08:06:143
2342599621,50cyclictest30887-21ssh07:04:163
2342599621,43cyclictest9486-21rm06:39:063
2342299623,51cyclictest23746-21kworker/0:007:41:070
23422996222,9cyclictest0-21swapper/006:05:590
23422996216,33cyclictest23979-21df_inode06:01:030
2342299621,43cyclictest0-21swapper/006:25:590
2342599611,49cyclictest24004-21ssh08:14:103
2342599611,46cyclictest12657-21ssh08:00:493
2342599611,43cyclictest9731-21ssh07:16:573
2342599611,43cyclictest9731-21ssh07:16:573
2342599611,43cyclictest0-21swapper/306:33:283
23422996150,5cyclictest0-21swapper/005:56:010
2342599601,49cyclictest4670-21seq09:48:283
2342599601,49cyclictest16978-21ssh09:24:273
2342599601,48cyclictest4025-21ssh09:08:213
2342599601,43cyclictest29955-21ssh09:40:293
2342599601,42cyclictest28414-21sh08:19:413
2342599601,42cyclictest18473-21ssh06:49:553
23422996012,41cyclictest0-21swapper/009:31:010
23422996012,41cyclictest0-21swapper/009:31:010
2342599591,49cyclictest22967-21ssh07:33:323
2342599591,48cyclictest27479-21ssh07:00:453
2342599591,42cyclictest1113-21ssh09:05:353
2342599591,42cyclictest1113-21ssh09:05:353
2342599591,41cyclictest11538-21ntpq05:26:103
2342599591,39cyclictest6373-21ssh07:52:173
2342599591,37cyclictest28323-21ssh08:58:343
2342599591,31cyclictest7950irq/56-dwc_otg_06:26:083
23422995911,33cyclictest18223-21unixbench_multi08:06:180
23422995911,33cyclictest18223-21unixbench_multi08:06:180
240112580,2sleep20-21swapper/209:32:112
240112580,2sleep20-21swapper/209:32:112
2342599581,45cyclictest23899-21ssh08:53:003
2342599581,35cyclictest19547-21ssh09:26:343
23422995812,8cyclictest0-21swapper/004:45:590
2342299581,11cyclictest12402-21cron08:00:480
2342599572,50cyclictest30463-21apt-get09:40:593
2342599571,38cyclictest7882-21ssh08:33:533
2342599571,36cyclictest24899-21/usr/sbin/munin06:01:153
23423995722,21cyclictest25241-21ssh08:16:011
2342299579,26cyclictest31283-21fschecks_time06:21:060
2342299575,27cyclictest0-21swapper/009:25:490
23422995728,8cyclictest12482-21sort07:21:050
23422995722,18cyclictest7850irq/56-dwc_otg_05:50:480
23422995719,28cyclictest908-21runrttasks09:02:340
23422995719,28cyclictest908-21runrttasks09:02:340
2342299571,32cyclictest28223-21grep04:41:140
2342299571,30cyclictest0-21swapper/006:36:140
2342599561,44cyclictest0-21swapper/305:31:553
2342599561,43cyclictest7950irq/56-dwc_otg_07:11:373
2342599561,40cyclictest17683-21runrttasks05:42:373
2342599561,40cyclictest0-21swapper/305:18:033
2342599561,36cyclictest26766-21seq04:40:103
2342599561,35cyclictest31211-21df_inode06:21:043
2342599561,30cyclictest19987-21/usr/sbin/munin05:51:093
23423995617,20cyclictest0-21swapper/106:05:591
2342599551,46cyclictest917-21snmpd08:47:463
2342599551,41cyclictest12418-21apt-get08:00:513
2342599551,36cyclictest0-21swapper/306:41:543
2342599551,34cyclictest917-21snmpd05:01:563
2342299557,30cyclictest0-21swapper/007:16:020
2342299557,30cyclictest0-21swapper/007:16:020
2342299556,23cyclictest5206-21grep07:11:190
23422995534,3cyclictest0-21swapper/007:36:160
2342299553,27cyclictest0-21swapper/005:31:170
2342299552,32cyclictest9090-21wget05:21:010
23422995511,5cyclictest7950irq/56-dwc_otg_07:35:480
2342599541,50cyclictest29582-21ntpq04:46:123
2342599541,40cyclictest3006550ssh07:41:233
23422995427,5cyclictest7850irq/56-dwc_otg_09:06:140
2342299541,29cyclictest11186-21fschecks_time06:41:050
2342599531,40cyclictest25504-21ssh09:34:563
2342599531,40cyclictest25504-21ssh09:34:563
2342299536,27cyclictest7579-21fschecks_time05:16:060
2342299533,29cyclictest30209-21timerwakeupswit06:16:150
2342299533,29cyclictest30209-21timerwakeupswit06:16:150
23422995329,4cyclictest3634-21latency_hist07:10:480
23422995325,12cyclictest7950irq/56-dwc_otg_08:26:070
23422995324,6cyclictest5459-21fschecks_count08:31:060
2342299532,28cyclictest30797-21aten_rbpower_vo04:51:010
23422995321,18cyclictest908-21runrttasks08:14:330
2342299531,6cyclictest29855-21ssh08:21:070
2342299531,28cyclictest13754-21fschecks_time08:41:050
2342299531,26cyclictest0-21swapper/009:50:480
2342299531,10cyclictest9550irq/80-mmc007:30:480
2342599521,31cyclictest0-21swapper/306:06:403
23422995228,5cyclictest7850irq/56-dwc_otg_08:46:060
2342299522,27cyclictest22031-21fschecks_time08:51:060
2342499513,7cyclictest0-21swapper/208:51:002
2342299519,21cyclictest0-21swapper/006:56:000
2342299517,7cyclictest20588-21grep06:51:190
2342299517,32cyclictest0-21swapper/005:35:540
2342299517,32cyclictest0-21swapper/005:35:540
23422995114,18cyclictest1933-21diskmemload08:56:060
2342599501,46cyclictest6210-21ps05:11:123
2342599501,46cyclictest27594-21df06:11:033
2342599501,45cyclictest24496-21ls04:31:153
2342599501,45cyclictest14228-21apt-get05:35:503
2342599501,45cyclictest14228-21apt-get05:35:503
2342599501,35cyclictest0-21swapper/305:47:493
2342399507,33cyclictest0-21swapper/104:36:011
2342299505,31cyclictest0-21swapper/005:11:000
2342299501,8cyclictest1602-21sh05:00:480
23422995016,4cyclictest9450irq/48-DMA09:12:250
2342299501,27cyclictest11110-21unixbench_singl09:16:170
2342599492,34cyclictest0-21swapper/305:09:473
23422994944,3cyclictest0-21swapper/009:56:100
2342299492,8cyclictest30603-21taskset09:41:030
23422994926,6cyclictest7850irq/56-dwc_otg_05:41:030
2342299492,4cyclictest0-21swapper/005:55:050
23422994923,7cyclictest0-21swapper/006:35:050
23422994821,8cyclictest4544-21aten_rbpower_cu07:51:010
23422994727,12cyclictest0-21swapper/009:53:080
23424994623,5cyclictest20265-21grep06:51:152
23423994619,5cyclictest18434-21sh08:06:321
23423994619,5cyclictest18434-21sh08:06:321
2342399461,8cyclictest0-21swapper/109:11:031
23422994617,12cyclictest3711-21wget05:06:010
23422994614,19cyclictest0-21swapper/005:05:010
2342499456,5cyclictest0-21swapper/208:41:002
2342399454,9cyclictest0-21swapper/105:25:581
228782453,35sleep00-21swapper/004:27:130
2342499442,10cyclictest7850irq/56-dwc_otg_09:05:582
23424994416,13cyclictest7850irq/56-dwc_otg_08:31:182
23423994410,16cyclictest0-21swapper/104:30:581
2342399434,9cyclictest7750irq/56-dwc_otg05:36:091
2342399434,9cyclictest7750irq/56-dwc_otg05:36:091
2342399431,27cyclictest7750irq/56-dwc_otg08:01:001
2342299433,6cyclictest7850irq/56-dwc_otg_05:25:580
149792430,2sleep223421-21cyclictest07:24:002
140182430,2sleep10-21swapper/106:44:331
23423994217,4cyclictest2655-21fschecks_time06:31:071
2342499417,24cyclictest0-21swapper/208:06:032
2342499417,24cyclictest0-21swapper/208:06:032
2342499417,22cyclictest0-21swapper/205:16:022
23423994118,5cyclictest22398-21if_wlan005:56:071
23424994019,6cyclictest12420-21ls08:00:482
2342499401,17cyclictest2162-21apt-get09:46:002
2342499397,24cyclictest0-21swapper/204:51:002
2342499392,7cyclictest7750irq/56-dwc_otg07:01:002
2342399396,20cyclictest7750irq/56-dwc_otg09:25:591
2342399391,6cyclictest0-21swapper/107:06:011
2342399391,5cyclictest0-21swapper/107:34:161
23423993910,20cyclictest26322-21ssh09:36:001
2342499385,26cyclictest15731-21missed_timers06:46:112
2342499383,16cyclictest7750irq/56-dwc_otg09:51:002
2342499381,25cyclictest19052-21ls05:46:152
2342399383,24cyclictest0-21swapper/108:51:001
2342399383,10cyclictest0-21swapper/106:11:011
23423993822,9cyclictest3785-21ssh09:07:541
2342399381,9cyclictest12776-21grep05:31:041
23423993816,8cyclictest1933-21diskmemload09:25:341
2342399381,27cyclictest2170-21cut05:01:051
2342399381,25cyclictest12481-21cut07:21:051
317422371,4sleep20-21swapper/208:23:152
2342499372,18cyclictest0-21swapper/207:07:112
23424993710,11cyclictest25577-21systemd-journal05:11:592
2342499370,27cyclictest0-21swapper/207:16:382
2342499370,27cyclictest0-21swapper/207:16:382
2342399378,22cyclictest0-21swapper/104:45:591
2342399372,7cyclictest7850irq/56-dwc_otg_05:15:591
23423993718,4cyclictest1503-21unixbench_singl06:26:171
23424993619,9cyclictest28222-21sh08:19:202
2342399369,9cyclictest0-21swapper/104:51:001
2342399361,4cyclictest0-21swapper/107:51:001
23423993614,6cyclictest5148-21acpi08:31:001
23423993614,4cyclictest10185-21sh07:56:441
2342499359,5cyclictest7750irq/56-dwc_otg07:36:092
2342499357,15cyclictest0-21swapper/209:26:012
2342499351,4cyclictest7950irq/56-dwc_otg_06:36:092
2342499351,31cyclictest4123-21ssh07:11:042
2342399359,4cyclictest0-21swapper/109:41:011
2342399358,18cyclictest7750irq/56-dwc_otg08:41:041
2342399357,19cyclictest7750irq/56-dwc_otg09:20:071
2342399356,14cyclictest0-21swapper/106:51:031
2342399355,5cyclictest7850irq/56-dwc_otg_06:01:041
2342399352,5cyclictest0-21swapper/108:28:561
2342399351,8cyclictest9575-21fschecks_count08:36:051
2342399351,5cyclictest0-21swapper/108:23:311
2342399351,26cyclictest0-21swapper/109:35:371
2342399351,26cyclictest0-21swapper/109:35:371
2342399351,24cyclictest1577-21grep07:46:171
2342399351,24cyclictest1577-21grep07:46:171
23423993510,14cyclictest0-21swapper/108:58:051
2342499347,23cyclictest0-21swapper/205:41:022
2342499347,15cyclictest0-21swapper/208:46:022
2342499342,5cyclictest0-21swapper/204:46:022
2342499341,5cyclictest11723-21unixbench_singl09:56:192
2342399346,19cyclictest7750irq/56-dwc_otg10:00:491
2342399345,19cyclictest7750irq/56-dwc_otg05:46:021
2342399344,14cyclictest29906-21ssh09:01:001
2342399344,14cyclictest29906-21ssh09:01:001
2342399344,12cyclictest0-21swapper/105:50:581
23423993411,5cyclictest29496-21fschecks_time06:16:051
23423993411,5cyclictest29496-21fschecks_time06:16:051
2342399341,10cyclictest0-21swapper/104:56:011
23423993410,6cyclictest0-21swapper/108:10:581
2342499337,6cyclictest0-21swapper/209:01:022
2342499337,6cyclictest0-21swapper/209:01:022
2342499336,5cyclictest7750irq/56-dwc_otg06:56:052
2342499335,18cyclictest0-21swapper/206:05:372
2342499335,12cyclictest7850irq/56-dwc_otg_08:56:032
2342499331,9cyclictest0-21swapper/207:45:542
2342499331,9cyclictest0-21swapper/207:45:542
2342499331,7cyclictest13945-21ssh08:01:162
2342499331,23cyclictest0-21swapper/206:43:272
2342399333,16cyclictest0-21swapper/107:19:141
2342399333,16cyclictest0-21swapper/107:19:141
23423993312,5cyclictest0-21swapper/107:45:491
2342399331,24cyclictest23939-21cut06:56:061
2342399331,21cyclictest18526-21ls08:46:151
23423993310,10cyclictest2547-21fschecks_time09:46:061
2342499327,5cyclictest7850irq/56-dwc_otg_07:55:482
2342499326,5cyclictest7950irq/56-dwc_otg_05:21:152
2342499326,17cyclictest0-21swapper/207:31:022
2342499325,4cyclictest3480-21unixbench-2d06:31:172
2342499324,6cyclictest7850irq/56-dwc_otg_07:45:492
2342499324,15cyclictest7950irq/56-dwc_otg_06:20:492
2342499324,15cyclictest7950irq/56-dwc_otg_06:20:492
23424993225,5cyclictest30935-21if_eth009:41:072
2342499321,9cyclictest22240-21grep05:56:052
2342499321,25cyclictest0-21swapper/208:37:592
2342399327,13cyclictest0-21swapper/105:41:061
2342399326,7cyclictest0-21swapper/106:20:591
2342399321,7cyclictest0-21swapper/107:40:481
2342399321,5cyclictest27978-21aten_rbpower_po07:01:031
2342399321,10cyclictest9147-21cut05:21:011
2342499317,14cyclictest0-21swapper/205:55:062
2342499315,6cyclictest7750irq/56-dwc_otg09:17:512
2342499311,4cyclictest0-21swapper/208:30:052
2342499311,3cyclictest7850irq/56-dwc_otg_04:56:022
2342499311,25cyclictest1200-21switchtime06:26:142
2342499311,21cyclictest28034-21ls04:41:122
2342499311,20cyclictest12489-21ls05:30:482
23424993111,9cyclictest26072-21cat06:06:092
23424993111,6cyclictest27534-21unixbench_multi09:36:152
23423993110,5cyclictest7750irq/56-dwc_otg04:41:131
2342499309,10cyclictest0-21swapper/208:10:542
2342499306,13cyclictest7950irq/56-dwc_otg_05:01:052
2342499303,7cyclictest7950irq/56-dwc_otg_06:21:022
2342499303,7cyclictest4400-21grep05:06:112
2342499303,13cyclictest7950irq/56-dwc_otg_04:36:022
23424993017,10cyclictest0-21swapper/205:36:162
23424993017,10cyclictest0-21swapper/205:36:162
2342499301,6cyclictest28457-21unixbench-2d06:11:152
2342499301,5cyclictest7850irq/56-dwc_otg_07:26:122
2342399291,26cyclictest3889-21cut05:06:041
228582294,15sleep20-21swapper/204:26:592
2342499272,13cyclictest0-21swapper/204:31:092
228472273,14sleep10-21swapper/104:26:501
228642263,15sleep30-21swapper/304:27:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional