You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 17:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Thu Jun 18, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
664522150,5sleep36651-21kernelversion19:05:223
797199967,71cyclictest0-21swapper/023:30:160
75082910,1sleep10-21swapper/123:27:331
254102870,1sleep00-21swapper/023:48:580
254102870,1sleep00-21swapper/023:48:580
7972998340,22cyclictest14249-21ls20:55:231
797199827,35cyclictest0-21swapper/021:05:170
322832780,3sleep032248-21ssh22:40:300
320922780,3sleep132071-21ssh00:35:041
7972997735,18cyclictest6185-21rm21:32:151
90972750,2sleep00-21swapper/020:40:290
797199751,29cyclictest0-21swapper/019:45:150
797199743,31cyclictest0-21swapper/022:50:150
82892730,2sleep10-21swapper/122:12:531
82892730,2sleep10-21swapper/122:12:531
7972997337,14cyclictest32559-21ls22:40:321
7972997240,14cyclictest729-21apt-get23:20:151
7971997220,10cyclictest0-21swapper/021:20:160
7972997133,19cyclictest3914-21ssh00:00:441
7972997033,24cyclictest23954-21ssh23:46:251
7972997033,24cyclictest23954-21ssh23:46:251
7972996938,11cyclictest28678-21/usr/sbin/munin21:20:291
7972996936,19cyclictest14206-21apt-get22:20:101
7972996836,17cyclictest8806-21/usr/sbin/munin19:10:291
7972996833,19cyclictest21947-21ssh23:05:591
7972996827,22cyclictest15795-21taskset23:37:061
70062680,5sleep17007-21/usr/sbin/munin19:05:281
7972996733,15cyclictest12537-21rm22:17:491
7972996731,19cyclictest2568-21ssh00:37:471
7972996730,20cyclictest858-21ssh23:57:501
7972996728,15cyclictest27097-21rm00:28:541
7972996634,19cyclictest11309-21ssh23:31:441
7972996634,13cyclictest4759-21ssh22:45:571
7972996633,13cyclictest20682-21ssh23:43:101
7972996622,25cyclictest7950irq/56-dwc_otg_22:34:361
7971996618,10cyclictest0-21swapper/022:05:140
7972996540,9cyclictest19496-21ls19:40:251
7972996528,13cyclictest18874-21diskmemload23:15:531
7972996528,13cyclictest18874-21diskmemload23:15:531
7972996528,11cyclictest13670-21grep21:40:321
7972996528,11cyclictest13670-21grep21:40:321
7972996527,13cyclictest20334-21ntp_kernel_pll_00:20:261
797199653,28cyclictest0-21swapper/023:15:140
797199653,28cyclictest0-21swapper/023:15:140
797199651,32cyclictest0-21swapper/000:25:140
797199651,30cyclictest0-21swapper/022:10:180
797199651,30cyclictest0-21swapper/022:10:180
7972996435,12cyclictest30461-21ntp_states20:10:271
7972996435,12cyclictest30461-21ntp_states20:10:271
7972996431,14cyclictest26036-21ssh21:17:401
7971996413,8cyclictest101ktimersoftd/023:00:150
7971996413,8cyclictest101ktimersoftd/023:00:150
7972996336,17cyclictest15261-21ssh22:59:221
7972996334,12cyclictest18798-21ssh23:03:061
7972996334,12cyclictest18798-21ssh23:03:061
7972996333,9cyclictest3126-21ssh22:06:201
7972996333,13cyclictest1271-21ssh21:26:081
7972996329,12cyclictest28620-21rm23:52:071
7972996234,19cyclictest14097-21ssh00:13:361
7972996232,11cyclictest26641-21ssh23:11:421
7972996231,10cyclictest21575-21ssh21:12:221
7972996231,10cyclictest21575-21ssh21:12:221
7972996229,21cyclictest20894-21ssh21:50:071
797199624,33cyclictest6091-21kworker/0:220:35:050
7972996130,14cyclictest0-21swapper/122:51:161
7972996129,20cyclictest12975-21taskset19:21:181
7972996129,20cyclictest12975-21taskset19:21:181
7972996127,17cyclictest8054-21ssh21:35:051
7972996124,11cyclictest21979-21ssh22:29:111
797199612,47cyclictest26729-21fschecks_time23:50:220
22752610,2sleep20-21swapper/222:05:292
7972996037,9cyclictest30118-21ls22:00:231
7972996032,12cyclictest6888-21sed20:35:241
7972996031,14cyclictest27861-21ssh21:57:481
7972996031,12cyclictest21843-21unixbench_multi19:45:311
7972996028,11cyclictest18593-21ssh21:46:301
7972996027,23cyclictest8445-21ssh00:06:111
7971996038,5cyclictest21620-21grep23:05:330
797199602,29cyclictest1200-21unixbench_singl00:35:300
797199601,41cyclictest0-21swapper/021:32:130
797199601,40cyclictest15451-21ssh22:20:310
797199601,39cyclictest24685-21aten_rbpower_cu23:10:180
7972995934,11cyclictest27950-21/usr/sbin/munin20:05:131
7972995929,12cyclictest14786-21taskset19:26:211
7972995929,11cyclictest16699-21chrt21:00:431
7972995928,12cyclictest17761-21ssh00:17:311
7972995824,12cyclictest0-21swapper/120:27:231
797199585,27cyclictest29294-21latency_hist22:00:040
797199581,36cyclictest17502-21latency_hist23:40:040
7972995735,11cyclictest29274-21ssh22:37:011
7972995728,15cyclictest4678-21wget20:30:161
797199571,31cyclictest27484-21fschecks_time22:35:220
7972995631,11cyclictest10785-21/usr/sbin/munin19:15:301
7972995630,12cyclictest27495-21chrt20:02:271
797199562,30cyclictest3799-21unixbench_multi00:00:390
7971995621,8cyclictest0-21swapper/023:25:140
797199561,45cyclictest0-21swapper/021:25:220
797199561,14cyclictest0-21swapper/020:25:150
75172563,13sleep00-21swapper/019:07:390
178082560,2sleep00-21swapper/000:17:360
7972995529,12cyclictest18552-21sshd21:06:201
7971995525,5cyclictest11955-21aten_rbpower_en20:50:180
7972995428,12cyclictest13575-21sed20:55:041
797199541,5cyclictest32054-21munin-plugin-st00:35:040
34522540,2sleep20-21swapper/200:39:202
7972995327,11cyclictest750-21snmpd19:30:391
7972995324,15cyclictest7850irq/56-dwc_otg19:53:531
7972995322,14cyclictest9756-21taskset20:44:041
7972995322,13cyclictest18498-21runrttasks19:37:381
7971995336,4cyclictest30992-21fschecks_time23:55:220
797199533,29cyclictest6745-21/usr/sbin/munin00:05:170
7971995319,16cyclictest16260-21wc19:30:290
7974995242,7cyclictest8050irq/56-dwc_otg_21:45:133
7972995226,12cyclictest598-21chrt20:19:051
7971995122,13cyclictest8050irq/56-dwc_otg_19:15:170
797199512,16cyclictest0-21swapper/020:15:050
797199512,16cyclictest0-21swapper/020:15:050
797199511,36cyclictest0-21swapper/020:55:230
7974995012,23cyclictest0-21swapper/320:00:173
7972995033,13cyclictest25361-21timerwakeupswit19:55:321
7971995046,2cyclictest0-21swapper/023:42:190
7971995026,5cyclictest8679-21grep19:10:260
7971995025,13cyclictest8050irq/56-dwc_otg_21:50:270
7971995022,15cyclictest16979-21fschecks_count21:45:200
7971995018,5cyclictest11319-21fschecks_count00:10:210
797199501,36cyclictest0-21swapper/021:15:040
797199501,36cyclictest0-21swapper/021:15:040
797199501,32cyclictest12566-21aten_rbpower_vo21:40:180
797199501,32cyclictest12566-21aten_rbpower_vo21:40:180
7971995012,21cyclictest8129-21gpgv20:40:050
797399493,8cyclictest7950irq/56-dwc_otg_23:00:152
797399493,8cyclictest7950irq/56-dwc_otg_23:00:152
7972994934,12cyclictest11580-21sshd20:49:201
7972994925,11cyclictest2465-21runrttasks20:24:391
7971994930,4cyclictest125-21systemd-journal00:21:150
7971994926,3cyclictest0-21swapper/019:50:150
797199492,22cyclictest0-21swapper/023:21:060
7971994920,13cyclictest22874-21wget22:30:170
797199491,27cyclictest17628-21latency19:35:240
7971994825,4cyclictest0-21swapper/019:20:100
7971994825,4cyclictest0-21swapper/019:20:100
7971994818,20cyclictest0-21swapper/022:29:420
797199481,28cyclictest0-21swapper/022:55:240
7971994810,21cyclictest0-21swapper/022:15:140
797399478,27cyclictest0-21swapper/223:20:172
797199473,32cyclictest14644-21kworker/0:022:00:260
797199471,27cyclictest19145-21sshd19:40:200
797399462,5cyclictest29-21rcuc/200:20:212
797199462,41cyclictest0-21swapper/021:00:270
7971994623,6cyclictest8274-21cut21:35:180
797199451,27cyclictest25543-21ssh21:16:490
797199451,20cyclictest0-21swapper/022:45:180
7974994419,4cyclictest7950irq/56-dwc_otg_19:10:323
7974994415,12cyclictest8050irq/56-dwc_otg_23:28:553
797399447,24cyclictest0-21swapper/219:20:092
797399447,24cyclictest0-21swapper/219:20:092
797399441,7cyclictest7950irq/56-dwc_otg_22:10:172
797399441,7cyclictest7950irq/56-dwc_otg_22:10:172
797199447,22cyclictest24341-21runrttasks19:55:150
797199444,13cyclictest941-21/usr/sbin/munin20:20:250
7974994323,8cyclictest8050irq/56-dwc_otg_22:45:583
7974994314,11cyclictest8050irq/56-dwc_otg_20:55:283
797199436,18cyclictest29703-21ls20:10:050
797199435,7cyclictest0-21swapper/019:25:310
797199432,23cyclictest0-21swapper/020:46:200
7971994312,21cyclictest27247-21unixbench_multi20:00:320
205512430,2sleep20-21swapper/222:26:432
120242430,2sleep30-21swapper/321:39:583
797399425,9cyclictest7850irq/56-dwc_otg21:35:152
7971994216,15cyclictest0-21swapper/020:16:170
797499416,22cyclictest0-21swapper/322:55:173
797499409,18cyclictest8050irq/56-dwc_otg_19:15:363
7974994020,8cyclictest7950irq/56-dwc_otg_22:43:283
7974994018,8cyclictest8050irq/56-dwc_otg_22:17:263
7974994017,9cyclictest8050irq/56-dwc_otg_21:40:223
7974994017,9cyclictest8050irq/56-dwc_otg_21:40:223
7974994011,12cyclictest8050irq/56-dwc_otg_23:40:243
7973994010,6cyclictest31-21ksoftirqd/222:20:322
797499397,5cyclictest0-21swapper/322:20:183
797499392,21cyclictest26461-21ssh22:34:323
7974993918,10cyclictest8050irq/56-dwc_otg_00:09:003
7974993916,6cyclictest8212-21apt-config20:40:053
7974993915,12cyclictest8050irq/56-dwc_otg_00:34:393
7974993914,14cyclictest8050irq/56-dwc_otg_20:35:263
7974993913,5cyclictest26125-21latency_hist23:50:053
7974993913,5cyclictest26125-21latency_hist23:50:053
797399392,20cyclictest7950irq/56-dwc_otg_00:00:052
7973993920,8cyclictest31-21ksoftirqd/220:55:042
7974993825,4cyclictest8050irq/56-dwc_otg_23:05:183
7974993816,10cyclictest8050irq/56-dwc_otg_22:03:133
7974993814,10cyclictest381ktimersoftd/323:03:103
7974993814,10cyclictest381ktimersoftd/323:03:103
797499381,19cyclictest0-21swapper/300:20:273
797499381,18cyclictest8050irq/56-dwc_otg_00:26:333
7974993811,11cyclictest8050irq/56-dwc_otg_19:40:043
797399387,14cyclictest31-21ksoftirqd/219:55:312
7973993823,4cyclictest8050irq/56-dwc_otg_23:40:152
96362370,7sleep2797399cyclictest00:08:162
797499376,16cyclictest8050irq/56-dwc_otg_20:30:263
797499374,13cyclictest8050irq/56-dwc_otg_23:50:313
7974993721,6cyclictest8050irq/56-dwc_otg_22:06:273
7974993714,9cyclictest7950irq/56-dwc_otg_20:05:143
7974993713,6cyclictest381ktimersoftd/321:12:233
7974993713,6cyclictest381ktimersoftd/321:12:233
7974993712,11cyclictest7950irq/56-dwc_otg_21:23:453
797499371,14cyclictest8050irq/56-dwc_otg_23:35:043
797399379,5cyclictest0-21swapper/222:40:222
797399374,16cyclictest8050irq/56-dwc_otg_23:05:222
7973993720,6cyclictest31-21ksoftirqd/200:00:332
7973993716,12cyclictest31-21ksoftirqd/219:45:262
797399371,24cyclictest0-21swapper/222:00:162
75302370,5sleep2797399cyclictest20:35:322
797499369,12cyclictest7950irq/56-dwc_otg_23:57:523
7974993623,3cyclictest8050irq/56-dwc_otg_00:17:333
7974993620,8cyclictest8050irq/56-dwc_otg_23:20:173
7974993620,7cyclictest7850irq/56-dwc_otg20:10:243
7974993620,7cyclictest7850irq/56-dwc_otg20:10:243
7974993617,8cyclictest8050irq/56-dwc_otg_00:15:053
7974993615,7cyclictest7950irq/56-dwc_otg_22:26:233
7974993615,10cyclictest27940-21ssh21:57:563
7974993614,8cyclictest381ktimersoftd/319:40:263
7974993611,12cyclictest7950irq/56-dwc_otg_23:37:543
7973993617,5cyclictest27258-21processes23:50:292
326212360,1sleep30-21swapper/300:35:183
251972360,1sleep20-21swapper/223:48:352
251972360,1sleep20-21swapper/223:48:352
797499358,12cyclictest29453-21chrt22:37:193
797499356,4cyclictest7950irq/56-dwc_otg_22:10:263
797499356,4cyclictest7950irq/56-dwc_otg_22:10:263
797499351,13cyclictest0-21swapper/322:54:063
797399358,6cyclictest31-21ksoftirqd/220:30:122
797399357,12cyclictest8050irq/56-dwc_otg_21:50:032
797399352,4cyclictest7850irq/56-dwc_otg00:10:312
797399352,16cyclictest8050irq/56-dwc_otg_19:35:042
797399352,15cyclictest8050irq/56-dwc_otg_23:25:142
7973993514,14cyclictest27754-21ssh22:35:262
797399351,25cyclictest28735-21ls23:15:052
797399351,16cyclictest29-21rcuc/221:15:042
797399351,16cyclictest29-21rcuc/221:15:042
797499347,12cyclictest8050irq/56-dwc_otg_21:34:493
797499342,15cyclictest8050irq/56-dwc_otg_21:52:163
7974993418,4cyclictest8050irq/56-dwc_otg_23:17:283
7974993418,4cyclictest8050irq/56-dwc_otg_23:17:283
7974993416,12cyclictest7950irq/56-dwc_otg_23:11:433
7974993415,8cyclictest8050irq/56-dwc_otg_00:00:243
797399347,8cyclictest31-21ksoftirqd/221:20:312
797399344,5cyclictest7850irq/56-dwc_otg22:50:292
7973993426,6cyclictest301ktimersoftd/220:45:142
797499334,4cyclictest8050irq/56-dwc_otg_21:15:153
7974993317,9cyclictest8050irq/56-dwc_otg_20:52:203
797499331,3cyclictest8050irq/56-dwc_otg_20:15:153
7974993313,11cyclictest8050irq/56-dwc_otg_21:26:133
797399336,6cyclictest31-21ksoftirqd/200:28:492
7973993314,4cyclictest12984-21grep22:55:322
797399331,24cyclictest10423-21ls23:30:312
7973993311,9cyclictest301ktimersoftd/200:35:042
7973993311,4cyclictest31-21ksoftirqd/219:10:052
151052330,4sleep215103-21munin-run19:30:032
797499326,15cyclictest0-21swapper/321:00:173
797499322,20cyclictest0-21swapper/319:57:403
797499321,17cyclictest8050irq/56-dwc_otg_19:51:313
797399327,8cyclictest8050irq/56-dwc_otg_21:40:312
797399327,8cyclictest8050irq/56-dwc_otg_21:40:312
797399327,5cyclictest0-21swapper/200:15:252
797399326,6cyclictest7850irq/56-dwc_otg20:05:202
797399325,13cyclictest7950irq/56-dwc_otg_21:15:172
797399324,15cyclictest8050irq/56-dwc_otg_19:50:242
797399323,4cyclictest31-21ksoftirqd/220:10:202
797399323,4cyclictest31-21ksoftirqd/220:10:202
797399321,6cyclictest7950irq/56-dwc_otg_20:40:182
797499317,22cyclictest0-21swapper/319:20:183
797499317,22cyclictest0-21swapper/319:20:183
797399315,13cyclictest8050irq/56-dwc_otg_22:45:172
797399314,7cyclictest8050irq/56-dwc_otg_20:20:222
797399314,5cyclictest7850irq/56-dwc_otg21:25:332
797399314,10cyclictest0-21swapper/221:33:442
797399313,4cyclictest8050irq/56-dwc_otg_20:25:212
7973993125,4cyclictest31-21ksoftirqd/221:00:142
797399312,4cyclictest0-21swapper/223:35:232
797399311,21cyclictest0-21swapper/222:17:192
797399311,19cyclictest17989-21ls19:35:292
797399306,12cyclictest8050irq/56-dwc_otg_20:00:222
797399305,10cyclictest7950irq/56-dwc_otg_21:55:302
797399303,3cyclictest7850irq/56-dwc_otg22:30:262
7973993014,8cyclictest8050irq/56-dwc_otg_19:40:222
7973993012,6cyclictest31-21ksoftirqd/219:15:222
7973993010,4cyclictest0-21swapper/223:18:102
7973993010,4cyclictest0-21swapper/223:18:102
214432300,5sleep3797499cyclictest19:45:263
797499294,5cyclictest8050irq/56-dwc_otg_19:31:043
797499292,3cyclictest8050irq/56-dwc_otg_21:05:153
7974992921,6cyclictest505-21cron20:50:043
797399297,4cyclictest7850irq/56-dwc_otg20:55:212
797399281,4cyclictest21997-21ls21:50:292
66012287,13sleep26632-21kernelversion19:05:222
797499277,15cyclictest0-21swapper/320:25:173
797499271,20cyclictest0-21swapper/320:23:333
797499265,6cyclictest8050irq/56-dwc_otg_19:25:173
797399264,10cyclictest8050irq/56-dwc_otg_20:15:212
7973992515,7cyclictest17349-21aten_rbpower_en21:05:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional