You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 21:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Tue Apr 14, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1608921130,5sleep11316099cyclictest20:56:001
1545221100,4sleep231-21ksoftirqd/218:06:002
2433221050,2sleep024333-21basename21:05:570
324852930,1sleep30-21swapper/321:54:403
171872900,6sleep21316199cyclictest18:10:592
86232870,2sleep30-21swapper/320:07:063
207132780,2sleep00-21swapper/021:40:440
207132780,2sleep00-21swapper/021:40:440
317632770,5sleep21316199cyclictest19:17:012
1315999774,9cyclictest9-21ksoftirqd/019:25:540
256542720,2sleep00-21swapper/018:31:140
1315999646,12cyclictest28810-21cut21:11:000
322742620,1sleep10-21swapper/121:54:181
228202620,1sleep30-21swapper/319:46:013
13159996232,10cyclictest101ktimersoftd/021:45:540
1315999603,31cyclictest11387-21unixbench_singl19:31:120
1315999603,31cyclictest11387-21unixbench_singl19:31:120
1315999602,32cyclictest31456-21kworker/u8:220:55:590
13159995915,9cyclictest0-21swapper/021:25:570
1315999586,12cyclictest0-21swapper/020:45:580
1315999577,17cyclictest61-21kswapd021:55:560
13159995738,6cyclictest101ktimersoftd/018:16:120
13159995738,6cyclictest101ktimersoftd/018:16:120
1315999571,31cyclictest9-21ksoftirqd/017:41:010
13159995636,4cyclictest7950irq/56-dwc_otg_21:30:540
13159995636,4cyclictest0-21swapper/020:25:540
1315999562,50cyclictest3226-21latency_hist20:40:440
1315999562,50cyclictest3226-21latency_hist20:40:440
1315999561,52cyclictest3267-21cat20:01:040
1316099552,27cyclictest19269-21ssh20:20:551
13159995527,5cyclictest16572-21idleruntime-cro16:40:430
13159995526,7cyclictest5451-21unixbench_multi17:36:120
1315999552,31cyclictest4025-21idleruntime-cro21:20:430
1315999551,42cyclictest21474-21ls19:05:430
45672540,5sleep31316299cyclictest19:23:503
1316199541,19cyclictest0-21swapper/220:50:562
1316099542,7cyclictest23-21ksoftirqd/116:50:541
13159995417,14cyclictest20270-21latency_hist16:50:430
1315999541,37cyclictest0-21swapper/019:00:430
1315999541,33cyclictest22913-21unixbench_multi19:06:120
13159995411,23cyclictest0-21swapper/020:19:090
1315999539,5cyclictest0-21swapper/019:35:560
1315999532,29cyclictest0-21swapper/016:51:100
1315999531,5cyclictest1794-21/usr/sbin/munin19:21:000
1315999531,28cyclictest11790-21ssh20:11:070
1315999531,17cyclictest5181-21/usr/sbin/munin18:46:020
1315999531,17cyclictest5181-21/usr/sbin/munin18:46:020
13159995229,4cyclictest0-21swapper/021:45:430
13159995227,4cyclictest0-21swapper/018:25:560
13159995222,16cyclictest0-21swapper/017:50:430
1315999521,13cyclictest0-21swapper/020:41:340
13159995135,7cyclictest0-21swapper/016:55:560
13159995127,8cyclictest0-21swapper/021:23:030
1315999511,23cyclictest28929-21grep18:36:010
13159995111,2cyclictest0-21swapper/019:15:560
1315999506,26cyclictest9-21ksoftirqd/018:40:450
1316199493,21cyclictest7950irq/56-dwc_otg_17:36:042
1315999499,22cyclictest22701-21cut19:45:590
13159994922,5cyclictest18679-21fschecks_count19:40:590
1315999491,27cyclictest20653-21aten_rbpower_en18:20:560
1316099487,27cyclictest0-21swapper/116:45:571
13159994824,6cyclictest25056-21timerwakeupswit17:01:100
1315999482,26cyclictest0-21swapper/021:51:070
1315999482,24cyclictest13461-21cut18:00:570
13159994820,6cyclictest8051-21unixbench_multi20:06:120
13159994819,14cyclictest30863-21apt-get19:55:550
13159994818,14cyclictest28027-21uptime19:51:130
1315999481,31cyclictest0-21swapper/018:50:590
1315999481,28cyclictest0-21swapper/020:20:560
1315999472,16cyclictest0-21swapper/019:13:250
1315999471,29cyclictest31124-21munin-plugin-st17:20:430
1316099465,34cyclictest7950irq/56-dwc_otg_21:30:591
13160994620,17cyclictest0-21swapper/120:31:111
1316099461,29cyclictest7750irq/56-dwc_otg18:51:001
1316099461,26cyclictest0-21swapper/121:25:581
1315999466,25cyclictest0-21swapper/017:30:570
1315999466,25cyclictest0-21swapper/017:30:570
13159994628,5cyclictest7850irq/56-dwc_otg_20:55:260
13159994626,7cyclictest0-21swapper/017:06:150
1315999462,29cyclictest0-21swapper/017:56:060
1315999462,24cyclictest9-21ksoftirqd/016:41:100
1315999461,36cyclictest0-21swapper/018:06:090
1315999461,26cyclictest1178-21/usr/sbin/munin17:26:020
1316199451,16cyclictest0-21swapper/220:20:552
125712453,35sleep00-21swapper/016:26:340
1315999442,25cyclictest0-21swapper/018:12:500
13159994418,4cyclictest20491-21fschecks_time21:01:030
13159994417,17cyclictest0-21swapper/017:24:590
13159994416,13cyclictest2791050ssh20:30:590
1316199435,6cyclictest7950irq/56-dwc_otg_20:05:552
1316199431,9cyclictest0-21swapper/221:30:592
1316099437,25cyclictest0-21swapper/119:45:571
1316099437,15cyclictest739-21ssh21:16:031
13160994327,4cyclictest25577-21systemd-journal21:24:571
1316099431,15cyclictest0-21swapper/118:15:441
1315999435,21cyclictest9798-21aten_rbpower_cu17:50:580
1315999431,22cyclictest25577-21systemd-journal16:30:480
7492420,3sleep311-21rcu_preempt20:36:213
7492420,3sleep311-21rcu_preempt20:36:213
13162994226,9cyclictest381ktimersoftd/320:15:543
13161994227,5cyclictest2433-21rm21:56:282
13160994222,6cyclictest23926-21dhclient-script21:05:431
49382410,5sleep31316299cyclictest20:02:563
4782410,2sleep20-21swapper/218:40:582
13160994120,4cyclictest8148-21cpuspeed17:45:561
1315999411,8cyclictest29222-21idleruntime-cro17:15:430
1315999411,8cyclictest29222-21idleruntime-cro17:15:430
13161994022,9cyclictest25632-21ssh19:49:242
13160994020,5cyclictest22170-21idleruntime-cro18:25:431
60202390,1sleep20-21swapper/220:43:212
13161993917,5cyclictest9361-21grep21:26:092
1316199391,4cyclictest7750irq/56-dwc_otg19:06:112
1316199391,15cyclictest7950irq/56-dwc_otg_20:15:552
1316099397,23cyclictest0-21swapper/118:55:591
13160993918,4cyclictest28934-21idleruntime-cro21:50:431
1316099391,28cyclictest7950irq/56-dwc_otg_18:46:011
1316099391,28cyclictest7950irq/56-dwc_otg_18:46:011
13160993912,12cyclictest0-21swapper/120:35:551
13160993912,12cyclictest0-21swapper/120:35:551
13162993820,4cyclictest30944-21aten_rbpower_en19:55:583
13161993818,10cyclictest28316-21sh21:49:382
13161993817,5cyclictest916-21netstat21:16:052
13161993814,5cyclictest11879-21sensors20:11:082
13161993814,4cyclictest22148-21kworker/u8:318:30:432
1316199381,26cyclictest0-21swapper/221:10:442
1316099387,21cyclictest0-21swapper/117:15:571
1316099383,3cyclictest7850irq/56-dwc_otg_20:40:571
1316099382,23cyclictest25488-21rm20:27:341
13160993819,10cyclictest10593-21sh20:49:071
1316099381,25cyclictest10745-21timerwakeupswit17:51:111
1316299375,7cyclictest7850irq/56-dwc_otg_20:25:433
1316299371,27cyclictest14064-21ls19:35:443
1316299371,27cyclictest14064-21ls19:35:443
1316199374,16cyclictest7850irq/56-dwc_otg_18:21:102
1316199371,7cyclictest14297-21grep16:31:102
1316199371,19cyclictest7850irq/56-dwc_otg_19:20:562
1316199371,12cyclictest0-21swapper/218:31:032
1316099371,25cyclictest0-21swapper/119:06:021
1316099371,16cyclictest917-21snmpd18:44:251
1316099371,16cyclictest11587-21aten_rbpower_cu17:55:581
288792360,6sleep11316099cyclictest19:14:181
152372361,30sleep215343-21ls19:36:102
1316299365,15cyclictest18704-21ssh19:40:593
1316199365,23cyclictest0-21swapper/219:33:112
1316199365,23cyclictest0-21swapper/219:33:112
1316199364,13cyclictest29882-21grep18:36:132
13161993614,4cyclictest17490-21missed_timers21:36:052
13161993614,4cyclictest17490-21missed_timers21:36:052
1316199361,3cyclictest7950irq/56-dwc_otg_17:15:542
1316199361,14cyclictest18414-21grep19:01:102
1316099365,12cyclictest0-21swapper/121:11:011
1316099363,16cyclictest7950irq/56-dwc_otg_18:35:441
13160993622,7cyclictest7850irq/56-dwc_otg_19:25:581
1316099362,19cyclictest0-21swapper/119:16:481
13160993614,4cyclictest23966-21diskmemload21:37:451
13160993614,4cyclictest23966-21diskmemload21:37:451
305812350,1sleep20-21swapper/220:34:072
1316299355,12cyclictest7850irq/56-dwc_otg_20:41:143
13162993515,5cyclictest12616-21/usr/sbin/munin21:31:043
1316199357,4cyclictest7850irq/56-dwc_otg_18:46:132
1316199357,4cyclictest7850irq/56-dwc_otg_18:46:132
1316199355,19cyclictest8368-21ls20:46:062
13161993511,5cyclictest641-21sh21:55:432
13161993510,14cyclictest301ktimersoftd/217:45:432
1316099356,16cyclictest0-21swapper/117:10:561
1316099356,16cyclictest0-21swapper/117:10:561
1316099356,12cyclictest17577-21ssh19:00:581
13160993513,8cyclictest15537-21unixbench_singl19:36:121
126252351,4sleep312695-21ssh20:51:083
1316299349,3cyclictest0-21swapper/321:09:423
1316299349,12cyclictest0-21swapper/321:01:513
1316299348,5cyclictest7850irq/56-dwc_otg_21:15:003
1316299347,5cyclictest7850irq/56-dwc_otg_21:55:583
1316299346,4cyclictest0-21swapper/320:35:433
13162993426,6cyclictest4731-21runrttasks18:45:553
13162993426,6cyclictest4731-21runrttasks18:45:553
13162993414,5cyclictest1387-21/usr/sbin/munin18:41:093
1316299341,21cyclictest0-21swapper/319:15:443
1316199343,12cyclictest7950irq/56-dwc_otg_17:21:092
13161993417,5cyclictest28973-21sh19:14:282
13161993412,11cyclictest0-21swapper/221:20:562
1316099349,5cyclictest0-21swapper/119:51:031
1316099348,24cyclictest0-21swapper/120:00:491
1316099348,12cyclictest23953-21modprobe18:30:431
1316099341,6cyclictest2210-21grep21:56:141
1316099341,24cyclictest0-21swapper/119:20:481
1316099341,21cyclictest7750irq/56-dwc_otg18:30:561
1316299339,3cyclictest0-21swapper/318:34:173
1316299338,4cyclictest0-21swapper/320:56:093
1316299338,12cyclictest0-21swapper/318:58:413
1316299335,13cyclictest7950irq/56-dwc_otg_21:46:013
13162993316,5cyclictest23971-21modprobe18:30:433
1316299331,18cyclictest0-21swapper/319:04:123
13162993311,10cyclictest0-21swapper/321:22:033
1316199336,5cyclictest0-21swapper/219:25:542
1316199336,12cyclictest7850irq/56-dwc_otg_21:11:002
1316199335,4cyclictest0-21swapper/220:26:042
13161993318,8cyclictest93962chrt17:49:292
1316199331,5cyclictest16259-21grep20:56:032
13161993313,4cyclictest301ktimersoftd/218:57:032
1316199331,24cyclictest25603-21latency_hist17:05:442
1316199331,22cyclictest0-21swapper/216:40:542
1316199331,19cyclictest31660-21ssh19:56:082
1316199331,16cyclictest11629-21aten_rbpower_en17:55:582
1316099334,23cyclictest0-21swapper/117:35:571
1316099332,3cyclictest7750irq/56-dwc_otg20:50:531
1316099331,7cyclictest24323-21fschecks_time17:01:001
13160993317,9cyclictest7475-21sh20:06:051
1316099331,13cyclictest0-21swapper/119:31:071
1316099331,13cyclictest0-21swapper/119:31:071
1316299329,10cyclictest0-21swapper/319:39:553
1316299328,4cyclictest0-21swapper/321:37:333
1316299328,4cyclictest0-21swapper/321:37:333
1316299325,5cyclictest6726-21ntp_states19:26:063
1316299323,11cyclictest7850irq/56-dwc_otg_20:15:443
1316299321,12cyclictest0-21swapper/321:30:133
13162993210,9cyclictest7850irq/56-dwc_otg_17:51:093
1316199328,4cyclictest0-21swapper/218:53:372
1316199327,6cyclictest7950irq/56-dwc_otg_20:36:012
1316199327,6cyclictest7950irq/56-dwc_otg_20:36:012
1316199326,4cyclictest0-21swapper/219:52:202
1316199325,6cyclictest21359-21unixbench_multi21:01:152
1316199321,5cyclictest0-21swapper/220:00:572
1316199321,3cyclictest7950irq/56-dwc_otg_18:00:542
13161993213,11cyclictest11403-21cat17:55:432
1316199321,21cyclictest0-21swapper/216:52:562
1316099329,5cyclictest0-21swapper/117:31:121
1316099329,5cyclictest0-21swapper/117:31:121
1316099327,23cyclictest0-21swapper/118:05:561
1316099324,17cyclictest0-21swapper/120:00:441
1316099323,13cyclictest14981-21/usr/sbin/munin16:36:071
13160993214,5cyclictest12503-21sh20:11:361
1316099321,24cyclictest32525-21grep17:21:111
1316099321,11cyclictest19646-21grep19:41:101
1316299318,6cyclictest7714-21cron17:45:433
1316299318,10cyclictest0-21swapper/320:50:333
1316299313,13cyclictest7750irq/56-dwc_otg18:51:063
1316299313,12cyclictest7950irq/56-dwc_otg_18:16:023
1316299313,12cyclictest7950irq/56-dwc_otg_18:16:023
1316299311,7cyclictest27969-21grep19:51:133
1316299311,4cyclictest0-21swapper/321:41:283
13162993110,8cyclictest23966-21diskmemload21:20:023
1316199317,4cyclictest7950irq/56-dwc_otg_17:30:442
1316199316,4cyclictest0-21swapper/221:42:152
1316199311,9cyclictest18348-21ssh19:40:492
1316199311,24cyclictest0-21swapper/217:09:282
1316099314,3cyclictest0-21swapper/121:41:091
1316099313,5cyclictest9550irq/80-mmc020:20:431
1316099312,23cyclictest0-21swapper/116:31:081
1316099311,18cyclictest1067-21ls17:26:011
1316099311,14cyclictest0-21swapper/116:59:241
1316299308,13cyclictest7850irq/56-dwc_otg_17:10:573
1316299308,13cyclictest7850irq/56-dwc_otg_17:10:573
1316299305,13cyclictest7950irq/56-dwc_otg_17:21:113
1316299304,11cyclictest0-21swapper/319:19:523
13162993024,4cyclictest908-21runrttasks17:26:053
1316299302,19cyclictest0-21swapper/317:20:383
1316299301,5cyclictest29911-21sed18:36:133
13162993010,4cyclictest23807-21sort20:26:003
1316199302,5cyclictest7850irq/56-dwc_otg_18:15:592
1316199302,5cyclictest7850irq/56-dwc_otg_18:15:592
13161993014,5cyclictest301ktimersoftd/217:33:552
13161993014,5cyclictest301ktimersoftd/217:33:552
1316099309,11cyclictest0-21swapper/121:06:001
1316099309,10cyclictest17565-21proc_pri16:41:081
1316099302,7cyclictest27558-21chrt17:10:441
1316299297,11cyclictest7850irq/56-dwc_otg_19:06:123
1316299296,12cyclictest7950irq/56-dwc_otg_18:23:033
1316299295,4cyclictest7750irq/56-dwc_otg16:51:043
1316299295,12cyclictest7950irq/56-dwc_otg_17:56:003
1316199295,6cyclictest7950irq/56-dwc_otg_17:11:052
1316199295,6cyclictest7950irq/56-dwc_otg_17:11:052
1316099291,6cyclictest7750irq/56-dwc_otg18:15:591
1316099291,6cyclictest7750irq/56-dwc_otg18:15:591
1316299284,4cyclictest7850irq/56-dwc_otg_18:11:083
1316299282,16cyclictest0-21swapper/318:06:163
1316299281,5cyclictest14944-21munin-plugin-st18:05:433
1316299281,4cyclictest0-21swapper/316:46:403
1316299281,24cyclictest2724-21ls17:30:593
1316299281,24cyclictest2724-21ls17:30:593
1316199284,5cyclictest7950irq/56-dwc_otg_16:35:542
13160992821,5cyclictest13434-21cut18:00:571
1316099281,15cyclictest7950irq/56-dwc_otg_17:41:121
1316299274,12cyclictest7950irq/56-dwc_otg_16:31:013
1316299274,11cyclictest917-21snmpd17:36:053
1316299272,16cyclictest0-21swapper/316:59:493
1316299271,4cyclictest0-21swapper/316:35:543
1316199271,17cyclictest0-21swapper/216:48:132
13162992620,4cyclictest17648-21smartpower16:41:093
1316199263,6cyclictest22222-21/usr/sbin/munin16:56:022
126662261,15sleep10-21swapper/116:27:491
125592262,14sleep30-21swapper/316:26:253
1316299251,18cyclictest0-21swapper/317:08:473
125732253,14sleep20-21swapper/216:26:362
13162992418,4cyclictest24482-21if_wlan017:01:023
1316299233,13cyclictest8067-21wget17:45:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional