You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 17:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Mon Dec 15, 2025 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1499999418,47cyclictest0-21swapper/010:28:010
1499998018,13cyclictest7950irq/56-dwc_otg_11:05:020
149999774,18cyclictest0-21swapper/008:43:000
1499997416,4cyclictest13350-21cut10:43:060
1499997416,4cyclictest13350-21cut10:43:060
1499997414,12cyclictest7950irq/56-dwc_otg_10:03:150
1502997334,23cyclictest18543-21fschecks_time09:28:063
149999722,7cyclictest19707-21grep12:28:150
149999722,5cyclictest0-21swapper/007:30:020
1499997217,5cyclictest3772-21wget08:48:010
1499997015,37cyclictest0-21swapper/011:33:020
149999681,22cyclictest28979-21grep08:28:010
149999681,22cyclictest0-21swapper/009:28:170
1499996718,18cyclictest9667-21fschecks_time10:33:060
1499996712,14cyclictest23477-21/usr/sbin/munin08:13:040
1502996638,19cyclictest16180-21sed09:20:033
1499996620,12cyclictest0-21swapper/007:30:050
1502996537,20cyclictest4578-21cat08:48:123
1502996431,11cyclictest24494-21timerwakeupswit08:13:143
1502996430,13cyclictest6970-21grep11:53:173
150199645,26cyclictest7850irq/56-dwc_otg_07:32:592
1502996335,11cyclictest29156-21apt-get09:58:003
1502996334,18cyclictest24957-21unixbench-2d11:13:163
150199636,11cyclictest7950irq/56-dwc_otg_12:27:592
84662620,2sleep00-21swapper/008:58:170
1502996231,13cyclictest16477-21cat12:20:043
1502996229,12cyclictest10873-21apt-get07:37:593
1502996132,13cyclictest28805-21taskset08:26:383
1502996128,12cyclictest30968-21/usr/sbin/munin10:03:013
1502996035,11cyclictest6313-21cat08:53:133
1502996035,11cyclictest6313-21cat08:53:133
1502996032,14cyclictest26318-21sed08:18:143
1502996029,17cyclictest7535-21taskset11:56:143
1502995928,13cyclictest28682-21modprobe09:55:023
1502995927,13cyclictest18987-21/usr/sbin/munin12:28:063
149999598,11cyclictest0-21swapper/009:38:010
1502995830,13cyclictest16922-21aten_rbpower_vo12:23:033
1502995830,13cyclictest16922-21aten_rbpower_vo12:23:033
1502995828,10cyclictest7950irq/56-dwc_otg_10:38:083
1502995825,9cyclictest0-21swapper/309:14:413
1502995825,9cyclictest0-21swapper/309:14:413
1502995825,10cyclictest0-21swapper/311:18:143
1499995816,27cyclictest13976-21head09:13:160
1499995816,27cyclictest13976-21head09:13:160
1502995731,10cyclictest19790-21taskset10:59:483
1502995724,17cyclictest7850irq/56-dwc_otg_09:50:033
1499995726,5cyclictest5063-21grep10:18:160
1499995726,5cyclictest5063-21grep10:18:160
1502995626,14cyclictest2025-21latency_hist11:40:043
1502995626,14cyclictest2025-21latency_hist11:40:043
1500995631,8cyclictest29156-21apt-get09:57:591
1502995531,12cyclictest4758-21ntpq11:48:093
1502995528,11cyclictest21270-21taskset09:33:503
1500995514,26cyclictest6490-21sed08:53:151
1500995514,26cyclictest6490-21sed08:53:151
149999554,37cyclictest0-21swapper/008:20:030
1499995530,8cyclictest0-21swapper/010:37:590
1502995429,12cyclictest16776-21/usr/sbin/munin09:23:063
1502995424,8cyclictest0-21swapper/307:40:393
1502995424,15cyclictest16525-21taskset10:51:233
1502995422,9cyclictest0-21swapper/308:55:533
149999547,32cyclictest0-21swapper/010:53:020
1502995339,11cyclictest15384-21ls07:48:133
1502995336,13cyclictest8528-21ls10:28:143
1502995330,11cyclictest23101-21chrt09:39:133
1502995328,14cyclictest1841-21seq08:42:273
1502995328,11cyclictest1124-21snmpd12:01:353
1499995327,6cyclictest14353-21grep12:13:160
1499995325,12cyclictest7950irq/56-dwc_otg_10:15:030
1499995310,20cyclictest4393-21/usr/sbin/munin07:18:130
1502995230,11cyclictest20231-21chrt12:30:473
1502995227,16cyclictest1124-21snmpd09:41:313
1502995224,10cyclictest7950irq/56-dwc_otg_07:30:033
1502995223,12cyclictest12273-21chrt09:09:193
1502995220,10cyclictest7850irq/56-dwc_otg_07:18:123
150199522,16cyclictest7850irq/56-dwc_otg_09:43:002
150099527,12cyclictest7044-21head11:53:181
149999521,28cyclictest385-21wget10:08:020
1502995129,9cyclictest7950irq/56-dwc_otg_11:07:593
1502995128,10cyclictest28340-21sshd08:23:423
1502995126,15cyclictest32028-21chrt08:34:453
1502995120,10cyclictest0-21swapper/312:06:433
1500995110,23cyclictest17031-21/usr/sbin/munin12:23:051
1500995110,23cyclictest17031-21/usr/sbin/munin12:23:051
1499995127,5cyclictest22749-21unixbench-2d08:08:150
1499995127,5cyclictest22749-21unixbench-2d08:08:150
1499995125,5cyclictest18586-21wget10:58:020
149999512,29cyclictest28635-21unixbench_singl11:23:160
1499995120,21cyclictest0-21swapper/008:36:430
1502995035,11cyclictest938-21ls10:08:093
1502995034,12cyclictest10229-21timerwakeupswit09:03:153
1502995024,13cyclictest9124-21chrt10:30:173
1500995011,13cyclictest0-21swapper/110:03:071
149999506,20cyclictest9-21ksoftirqd/008:03:170
1499995025,3cyclictest0-21swapper/007:15:030
149999502,29cyclictest18169-21latency_hist12:25:030
149999502,29cyclictest18169-21latency_hist12:25:030
149999502,23cyclictest2881-21wc11:43:090
149999501,28cyclictest5748-21fschecks_count07:23:050
1502994937,10cyclictest12499-21apt-get10:40:083
1502994937,10cyclictest12499-21apt-get10:40:083
1502994936,11cyclictest20315-21/usr/sbin/munin08:03:083
1502994935,11cyclictest9870-21/usr/sbin/munin07:33:123
1502994935,11cyclictest16656-21if_err_eth007:53:073
1502994935,11cyclictest15123-21fschecks_count10:48:053
1502994935,11cyclictest14318-21unixbench_singl12:13:163
1502994923,9cyclictest7950irq/56-dwc_otg_11:28:143
1500994922,11cyclictest24830-21timerandwakeup11:13:151
1500994916,17cyclictest16639-21df_inode09:23:041
1500994915,17cyclictest25695-21/usr/sbin/munin11:18:151
149999492,7cyclictest11104-21fschecks_count07:38:050
1499994927,12cyclictest0-21swapper/009:33:080
149999492,30cyclictest0-21swapper/009:25:030
1499994921,6cyclictest12736-21cron12:10:030
149999491,28cyclictest15247-21fschecks_count12:18:040
1499994912,8cyclictest0-21swapper/012:38:010
1502994835,10cyclictest23031-21/usr/sbin/munin12:38:143
1502994831,14cyclictest32384-21taskset08:36:253
1502994824,12cyclictest21586-21chrt11:04:503
1502994821,16cyclictest0-21swapper/311:23:403
150199483,11cyclictest7950irq/56-dwc_otg_10:48:022
150099485,13cyclictest0-21swapper/109:55:031
149999481,9cyclictest32132-21latency_hist08:35:030
1502994735,10cyclictest5717-21sshd10:22:423
1502994735,10cyclictest5717-21sshd10:22:423
1502994733,11cyclictest3217-21awk10:13:163
150099477,25cyclictest0-21swapper/109:38:021
150099477,23cyclictest0-21swapper/108:55:081
1500994712,19cyclictest3836-21runrttasks10:16:531
1500994712,19cyclictest3836-21runrttasks10:16:531
1500994711,21cyclictest5022-21timerandwakeup11:48:141
1499994729,4cyclictest7850irq/56-dwc_otg_10:23:060
1499994729,4cyclictest7850irq/56-dwc_otg_10:23:060
1502994633,11cyclictest4482-21sed10:18:083
1502994633,11cyclictest4482-21sed10:18:083
1502994632,11cyclictest6431-21sed07:23:143
1502994632,11cyclictest18669-21cat07:58:103
150099467,26cyclictest0-21swapper/107:38:021
150099467,25cyclictest0-21swapper/110:22:591
150099467,25cyclictest0-21swapper/110:22:591
150099467,14cyclictest18904-21ntpq09:28:111
1499994627,6cyclictest7850irq/56-dwc_otg_09:53:020
321812453,13sleep00-21swapper/007:05:540
302532450,2sleep2301ktimersoftd/211:28:162
1502994532,11cyclictest2208-21chrt11:42:093
1502994531,11cyclictest2970-21taskset07:13:393
1502994519,11cyclictest7950irq/56-dwc_otg_08:08:123
1502994519,11cyclictest7950irq/56-dwc_otg_08:08:123
150199457,26cyclictest0-21swapper/212:13:022
150099458,13cyclictest26947-21date09:50:031
150099457,26cyclictest0-21swapper/110:58:011
150099457,24cyclictest0-21swapper/110:40:081
150099457,24cyclictest0-21swapper/110:40:081
1500994516,10cyclictest0-21swapper/107:33:001
1500994514,15cyclictest12358-21latency_hist09:10:031
1500994511,15cyclictest16344-21taskset12:20:021
1500994510,14cyclictest4673-21grep08:48:131
1499994524,5cyclictest7850irq/56-dwc_otg_07:53:120
1499994522,5cyclictest8475-21/usr/sbin/munin11:58:130
149999452,24cyclictest14926-21fschecks_time09:18:050
149999452,23cyclictest0-21swapper/011:08:130
149999452,19cyclictest0-21swapper/011:48:130
1499994520,14cyclictest29346-21wget11:28:020
1499994517,25cyclictest9210-21aten_rbpower_cu09:03:010
149999451,25cyclictest27040-21modprobe11:20:030
1502994431,10cyclictest0-21swapper/311:32:593
150099447,25cyclictest0-21swapper/107:23:011
150099447,24cyclictest0-21swapper/112:05:081
150099445,27cyclictest0-21swapper/111:08:001
1500994413,10cyclictest0-21swapper/108:12:591
149999443,5cyclictest0-21swapper/011:38:170
149999443,5cyclictest0-21swapper/011:38:170
1499994420,5cyclictest24195-21fschecks_time11:13:060
149999441,26cyclictest0-21swapper/012:02:290
150199431,8cyclictest7950irq/56-dwc_otg_11:38:002
150199431,8cyclictest7950irq/56-dwc_otg_11:38:002
150099438,9cyclictest0-21swapper/107:43:211
150099438,22cyclictest0-21swapper/112:33:021
150099437,21cyclictest0-21swapper/108:33:021
1500994327,13cyclictest15186-21ls09:18:071
1500994321,9cyclictest11150-21apt-get10:37:591
150099431,5cyclictest1676-21latency_hist10:10:031
1500994312,12cyclictest9339-21runrttasks10:32:591
1500994310,10cyclictest19286-21grep12:28:101
149999433,12cyclictest0-21swapper/009:48:160
1499994318,13cyclictest1125-21runrttasks12:31:320
150099426,10cyclictest7850irq/56-dwc_otg_11:23:451
1500994212,8cyclictest0-21swapper/107:13:151
1500994212,12cyclictest14748-21latency_hist12:15:041
1500994211,10cyclictest9476-21/usr/sbin/munin12:03:181
1500994210,16cyclictest2007-21latency_hist11:40:041
1500994210,16cyclictest2007-21latency_hist11:40:041
1500994210,16cyclictest1457-21latency_hist08:40:031
149999426,17cyclictest13-21rcuc/009:08:080
149999422,24cyclictest0-21swapper/010:48:530
1499994215,6cyclictest14790-21fschecks_time07:48:040
149999421,19cyclictest0-21swapper/009:45:030
149999421,14cyclictest0-21swapper/009:59:420
150199417,24cyclictest0-21swapper/211:08:022
150099417,13cyclictest16502-21diskstats07:53:051
150099414,14cyclictest0-21swapper/107:46:201
149999414,30cyclictest0-21swapper/008:53:100
149999414,30cyclictest0-21swapper/008:53:100
1499994117,15cyclictest0-21swapper/007:58:340
149999411,5cyclictest128-21systemd-journal08:20:520
150099405,15cyclictest23757-21latency_hist12:40:031
1500994014,14cyclictest14211-21sed09:15:031
1500994014,14cyclictest14211-21sed09:15:031
1500994014,11cyclictest30171-21chrt08:29:041
149999402,22cyclictest0-21swapper/011:54:570
150099395,20cyclictest1872-21taskset08:42:501
1500993915,11cyclictest25104-21taskset08:15:341
1499993912,5cyclictest142012chrt07:45:040
150199382,8cyclictest0-21swapper/208:52:592
150199382,8cyclictest0-21swapper/208:52:592
1501993819,4cyclictest1293250wget09:13:022
1501993819,4cyclictest1293250wget09:13:022
150199381,28cyclictest3539-21ls10:15:032
150099381,28cyclictest9556-21ls09:03:051
1500993812,16cyclictest3423-21taskset07:16:301
150199377,21cyclictest0-21swapper/208:18:012
150199376,3cyclictest0-21swapper/212:03:022
1501993717,5cyclictest1853150wget10:58:022
150099378,12cyclictest0-21swapper/111:29:051
150099377,13cyclictest24918-21chrt09:44:181
326972366,18sleep10-21swapper/107:08:061
3262366,19sleep232340-21/usr/sbin/munin07:08:072
150199368,15cyclictest7950irq/56-dwc_otg_09:23:052
150199367,22cyclictest0-21swapper/210:03:012
150199364,4cyclictest7850irq/56-dwc_otg_08:33:052
150199361,15cyclictest7850irq/56-dwc_otg_11:35:042
1500993617,9cyclictest7950irq/56-dwc_otg_08:02:331
1500993614,11cyclictest27700-21missed_timers08:23:081
151792350,1sleep10-21swapper/110:48:061
150199354,9cyclictest0-21swapper/209:28:012
150199354,15cyclictest7950irq/56-dwc_otg_08:25:032
150199353,20cyclictest0-21swapper/212:08:022
150199353,15cyclictest7950irq/56-dwc_otg_07:30:032
150199352,5cyclictest7850irq/56-dwc_otg_07:23:162
150199352,14cyclictest7950irq/56-dwc_otg_07:58:172
1501993518,5cyclictest17677-21timerwakeupswit10:53:162
150199351,3cyclictest7950irq/56-dwc_otg_09:02:592
150199351,19cyclictest12501-21latency_hist10:40:032
150099356,7cyclictest7759-21diskstats10:28:041
150099355,8cyclictest7850irq/56-dwc_otg_07:27:191
150099353,24cyclictest0-21swapper/107:59:511
150099352,10cyclictest21929-21fschecks_count08:08:041
150099352,10cyclictest21929-21fschecks_count08:08:041
1500993510,11cyclictest2236-21chrt11:42:311
150199345,6cyclictest7950irq/56-dwc_otg_10:20:042
150199345,6cyclictest7950irq/56-dwc_otg_10:20:042
1501993410,12cyclictest7950irq/56-dwc_otg_12:18:152
150099346,6cyclictest7750irq/56-dwc_otg11:03:161
150099346,12cyclictest21254-21taskset09:33:391
150099341,16cyclictest3221-21unixbench_multi10:13:161
150199336,15cyclictest0-21swapper/210:40:092
150199336,15cyclictest0-21swapper/210:40:092
1501993323,7cyclictest5031-21cron08:50:032
150199331,4cyclictest0-21swapper/208:40:042
1501993313,8cyclictest7850irq/56-dwc_otg_07:48:002
150099339,11cyclictest30997-21sshd11:31:431
150099335,12cyclictest0-21swapper/111:58:321
150199327,16cyclictest7850irq/56-dwc_otg_08:13:012
150199324,13cyclictest7950irq/56-dwc_otg_09:08:022
150199322,20cyclictest0-21swapper/210:06:352
150199321,16cyclictest0-21swapper/208:03:072
150199316,22cyclictest0-21swapper/209:45:082
150199316,15cyclictest0-21swapper/208:28:012
150199311,5cyclictest0-21swapper/209:58:002
150199311,21cyclictest14872-21uniq09:18:042
150199311,20cyclictest17407-21missed_timers12:23:102
150199311,20cyclictest17407-21missed_timers12:23:102
150199311,19cyclictest2154-21cut08:43:042
150199311,16cyclictest7950irq/56-dwc_otg_07:43:082
150199311,16cyclictest7850irq/56-dwc_otg_10:30:032
150199306,22cyclictest0-21swapper/207:18:012
150199303,5cyclictest7950irq/56-dwc_otg_11:03:032
150199303,13cyclictest7850irq/56-dwc_otg_10:33:162
150199303,12cyclictest7950irq/56-dwc_otg_07:13:022
150199302,7cyclictest7850irq/56-dwc_otg_11:53:022
150199302,19cyclictest0-21swapper/212:30:242
150199302,19cyclictest0-21swapper/209:40:042
150199302,19cyclictest0-21swapper/207:52:032
150199301,7cyclictest21139-21sed09:33:162
150199301,4cyclictest7950irq/56-dwc_otg_11:48:002
1501993014,6cyclictest128-21systemd-journal11:16:252
150199301,20cyclictest29-21rcuc/211:58:082
150199301,15cyclictest7850irq/56-dwc_otg_11:23:152
150099305,11cyclictest16521-21chrt10:51:201
150199291,14cyclictest7850irq/56-dwc_otg_07:38:052
150199291,12cyclictest7850irq/56-dwc_otg_11:43:082
12122294,17sleep31124-21snmpd07:09:503
150199285,6cyclictest7850irq/56-dwc_otg_08:55:082
150199285,4cyclictest7850irq/56-dwc_otg_09:51:092
150199285,4cyclictest7750irq/56-dwc_otg11:13:132
150199282,6cyclictest7950irq/56-dwc_otg_08:10:022
150199282,6cyclictest7950irq/56-dwc_otg_08:10:022
150199271,9cyclictest22213-21/usr/sbin/munin12:38:072
150199269,8cyclictest5992-21fschecks_count10:23:032
150199269,8cyclictest5992-21fschecks_count10:23:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional