You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 08:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Wed Jan 07, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1015124730,4sleep30-21swapper/319:05:333
11506991342,104cyclictest11505-21cyclictest19:10:160
11506991021,76cyclictest7431-21ps23:25:390
1150699991,84cyclictest0-21swapper/000:20:350
1150699981,76cyclictest17004-21aten_rbpower_cu19:25:300
1150699951,77cyclictest24445-21aten_rbpower_cu21:15:280
1150699941,78cyclictest19455-21ntpq19:30:370
1150699931,71cyclictest27123-21switchtime21:20:410
1150799901,62cyclictest0-21swapper/123:45:201
1150699901,74cyclictest128-21systemd-journal20:55:140
1150699881,69cyclictest30167-21aten_rbpower_po23:00:300
1150699871,70cyclictest128-21systemd-journal00:00:140
1150699862,67cyclictest23757-21grep21:10:430
1150699852,65cyclictest0-21swapper/022:35:260
1150699841,74cyclictest0-21swapper/000:00:360
1150699841,63cyclictest19171-21wc22:30:150
1150699831,67cyclictest10176-21apt-get22:05:250
1150699831,64cyclictest12154-21wget23:40:290
1150699822,65cyclictest0-21swapper/000:15:150
1150699821,67cyclictest28017-21cron22:55:140
1150699821,64cyclictest3620-21kworker/u8:221:05:290
1150699821,64cyclictest0-21swapper/020:26:530
11506998123,45cyclictest7850irq/56-dwc_otg_21:05:150
11506998123,45cyclictest7850irq/56-dwc_otg_21:05:150
1150699812,31cyclictest0-21swapper/020:24:190
1150699812,31cyclictest0-21swapper/020:24:190
1150699811,66cyclictest0-21swapper/019:20:420
1150699811,65cyclictest13677-21fschecks_time19:15:320
1150699781,70cyclictest0-21swapper/000:06:340
1150699781,63cyclictest0-21swapper/020:42:070
1150699781,58cyclictest0-21swapper/000:37:310
11506997812,55cyclictest8441-21aten_rbpower_po22:00:300
1150699771,65cyclictest2504-21runrttasks23:11:310
1150699771,65cyclictest2504-21runrttasks23:11:310
1150699771,62cyclictest0-21swapper/022:11:100
1150699771,60cyclictest0-21swapper/023:08:460
1150699761,62cyclictest29056-21taskset19:56:210
1150699761,61cyclictest274372sleep019:53:470
11507997514,34cyclictest0-21swapper/119:10:161
1150699741,58cyclictest31108-21taskset21:31:260
1150699741,58cyclictest0-21swapper/020:09:140
162172730,2sleep0101ktimersoftd/023:50:310
141672730,3sleep231-21ksoftirqd/220:45:372
1150699731,60cyclictest0-21swapper/000:31:580
1150699731,59cyclictest0-21swapper/022:46:270
1150699731,59cyclictest0-21swapper/000:29:120
1150699721,55cyclictest0-21swapper/021:44:130
29392710,4sleep11150799cyclictest21:45:261
1150699711,5cyclictest0-21swapper/020:57:450
1150699711,58cyclictest0-21swapper/020:19:390
1150699711,54cyclictest0-21swapper/019:46:030
1150999705,5cyclictest0-21swapper/321:10:293
1150699702,57cyclictest0-21swapper/022:18:570
1150699701,64cyclictest0-21swapper/019:38:190
1150699701,64cyclictest0-21swapper/019:38:190
1150699701,57cyclictest0-21swapper/020:32:160
1150699701,4cyclictest11649-21chrt23:37:350
1150699692,40cyclictest773-21acpi20:10:260
1150699691,59cyclictest0-21swapper/022:30:180
1150699691,58cyclictest0-21swapper/022:21:450
1150699691,58cyclictest0-21swapper/022:21:450
1150699691,53cyclictest0-21swapper/020:37:030
11506996912,29cyclictest0-21swapper/023:45:200
78622680,2sleep30-21swapper/321:57:113
1150699684,35cyclictest128-21systemd-journal23:16:590
1150699681,53cyclictest0-21swapper/021:39:220
1150699681,53cyclictest0-21swapper/021:39:220
1150699681,52cyclictest0-21swapper/020:49:470
1150699681,52cyclictest0-21swapper/020:01:330
1150699672,54cyclictest0-21swapper/000:18:070
1150699671,54cyclictest128-21systemd-journal23:22:000
1150699671,54cyclictest0-21swapper/021:52:070
1150699671,53cyclictest0-21swapper/023:34:400
1150699671,51cyclictest0-21swapper/021:49:240
11508996630,16cyclictest12218-21aten_rbpower_vo23:40:292
1150699661,56cyclictest0-21swapper/022:55:170
1150699661,2cyclictest0-21swapper/021:57:430
175742650,5sleep10-21swapper/120:55:351
11508996530,21cyclictest19754-21/usr/sbin/munin19:30:422
11508996529,19cyclictest27417-21/usr/sbin/munin21:20:442
1150699652,52cyclictest0-21swapper/022:43:420
11508996426,23cyclictest18870-21seq21:00:252
11508996426,23cyclictest18870-21seq21:00:252
1150699641,5cyclictest0-21swapper/019:41:160
1150699641,53cyclictest0-21swapper/021:25:580
11508996331,14cyclictest20433-21timerwakeupswit00:00:412
1150999621,6cyclictest7750irq/56-dwc_otg00:00:273
11508996228,11cyclictest16150-21wc19:20:422
11508996225,16cyclictest27594-21switchtime00:20:412
289352610,2sleep10-21swapper/122:55:381
11508996130,17cyclictest27803-21taskset22:52:292
11508996126,17cyclictest7733-21ls23:25:412
11508996126,11cyclictest23344-21/usr/sbin/munin21:10:392
11509996017,4cyclictest21736-21/usr/sbin/munin22:35:353
11508996027,11cyclictest1124-21snmpd00:17:112
11507996020,12cyclictest27062-21expr21:20:411
1150999591,4cyclictest7750irq/56-dwc_otg20:50:343
11508995934,19cyclictest0-21swapper/219:10:172
11508995933,10cyclictest7533-21sshd20:27:122
11508995930,19cyclictest30287-21df23:00:312
11508995919,14cyclictest13761-21if_wlan019:15:332
11507995929,20cyclictest23522-21ls21:10:411
11508995826,20cyclictest24860-21/usr/sbin/munin21:15:332
11508995822,23cyclictest27265-21taskset19:51:342
1150799589,25cyclictest0-21swapper/100:00:251
11507995817,25cyclictest21345-21fschecks_time22:35:301
1150999571,6cyclictest7950irq/56-dwc_otg_21:15:423
11508995726,7cyclictest21038-21apt-get22:35:252
11508995725,10cyclictest31631-21chrt00:32:232
11509995619,4cyclictest30206-21latency_hist00:30:153
1150999561,3cyclictest0-21swapper/320:30:423
1150999561,12cyclictest0-21swapper/322:52:353
11508995631,15cyclictest21138-21/usr/sbin/munin21:05:332
11508995627,19cyclictest25424-21chrt19:46:082
11508995625,12cyclictest17110-21chrt22:24:232
11508995625,12cyclictest17110-21chrt22:24:232
11508995623,22cyclictest18951-21taskset22:29:572
11508995621,25cyclictest18415-21runrttasks20:57:302
1150999551,5cyclictest21448-21/usr/sbin/munin21:05:373
1150999551,4cyclictest7950irq/56-dwc_otg_19:10:293
1150999551,13cyclictest7950irq/56-dwc_otg_22:00:373
11508995528,11cyclictest17184-21df_inode19:25:322
11508995523,14cyclictest9990-21taskset23:34:382
11508995522,21cyclictest11377-21chrt22:05:482
1150999544,5cyclictest1124-21snmpd22:15:353
1150999542,12cyclictest7950irq/56-dwc_otg_23:40:373
1150999542,12cyclictest0-21swapper/321:46:583
11508995428,13cyclictest2760-21taskset23:14:412
11508995428,13cyclictest2760-21taskset23:14:412
11508995423,11cyclictest4352-21taskset23:17:012
11508995422,19cyclictest2597-21seq21:44:122
11508995422,12cyclictest15455-21taskset23:48:402
11508995422,10cyclictest0-21swapper/223:40:032
11508995421,10cyclictest0-21swapper/200:06:092
11507995423,14cyclictest19176-21latency_hist22:30:151
11507995420,18cyclictest19288-21sed00:00:151
11507995418,22cyclictest8577-21df_inode22:00:321
11507995417,13cyclictest24679-21fschecks_count21:15:311
11507995413,24cyclictest15859-21seq19:20:381
1150999531,7cyclictest15346-21cpuspeed19:20:303
1150999531,3cyclictest7950irq/56-dwc_otg_21:23:483
11508995326,10cyclictest23271-21diskstats00:10:312
11508995325,10cyclictest18985-21chrt23:57:412
11508995323,11cyclictest5897-21chrt20:24:202
11508995323,11cyclictest5897-21chrt20:24:202
1150799532,9cyclictest0-21swapper/123:30:281
11507995321,10cyclictest30084-21apt-get23:00:291
11507995320,17cyclictest28079-21latency_hist22:55:151
11507995317,15cyclictest13551-21df_inode19:15:301
11507995317,13cyclictest21114-21fschecks_time21:05:331
11507995316,15cyclictest13514-21chrt23:43:151
11507995314,24cyclictest32717-21taskset20:07:001
1150999521,3cyclictest0-21swapper/300:05:343
11508995241,9cyclictest4875-21apt-get23:20:262
11508995228,14cyclictest21804-21sshd19:36:122
11508995228,14cyclictest21804-21sshd19:36:122
11508995225,12cyclictest8366-21/usr/sbin/munin22:00:272
11507995218,15cyclictest2425-21chrt21:42:001
11507995217,16cyclictest1380-21grep00:40:151
1150999513,10cyclictest0-21swapper/323:06:093
11508995123,11cyclictest29643-21chrt22:58:002
11508995122,17cyclictest683-21taskset21:39:202
11508995122,17cyclictest683-21taskset21:39:202
11508995122,17cyclictest11344-21seq20:39:362
11508995121,11cyclictest429-21chrt20:09:192
11508995119,12cyclictest29284-21taskset19:59:162
11507995122,14cyclictest7383-21ntp_states23:25:381
11507995120,18cyclictest27171-21cut00:20:351
11507995118,18cyclictest3290-21/usr/sbin/munin23:15:311
11507995116,15cyclictest19433-21grep19:30:371
1150999506,4cyclictest7750irq/56-dwc_otg22:05:343
1150999504,4cyclictest7750irq/56-dwc_otg22:43:243
1150999503,4cyclictest7950irq/56-dwc_otg_23:00:583
1150999502,5cyclictest11872-21cron23:40:143
1150999502,13cyclictest1125-21runrttasks21:00:103
11508995027,11cyclictest1038-21taskset00:37:572
11508995025,16cyclictest29260-21chrt21:25:592
11508995017,11cyclictest1124-21snmpd19:41:152
11507995024,14cyclictest10516-21perl22:05:321
1150999491,8cyclictest0-21swapper/319:38:303
1150999491,8cyclictest0-21swapper/319:38:303
11508994921,12cyclictest12994-21taskset20:42:312
11508994920,11cyclictest0-21swapper/220:54:572
11508994919,11cyclictest9323-21chrt20:31:572
11508994918,14cyclictest4187-21idleruntime-cro20:20:152
11507994916,10cyclictest0-21swapper/120:22:131
11507994916,10cyclictest0-21swapper/120:22:131
11509994815,4cyclictest24173-21/usr/sbin/munin19:45:423
11508994822,17cyclictest24298-21runrttasks22:44:012
11508994822,12cyclictest0-21swapper/222:32:442
11508994821,17cyclictest29969-21taskset00:29:102
11508994814,25cyclictest1125-21runrttasks21:34:122
1150799487,26cyclictest0-21swapper/119:45:281
1150999471,5cyclictest7950irq/56-dwc_otg_21:44:223
11508994731,12cyclictest24872-21/usr/sbin/munin22:45:302
11508994727,7cyclictest4506-21munin-run21:50:142
11508994723,10cyclictest6073-21chrt21:52:272
11508994719,10cyclictest0-21swapper/223:51:312
1150799477,25cyclictest0-21swapper/122:20:281
1150799477,25cyclictest0-21swapper/122:20:281
1150799477,25cyclictest0-21swapper/100:25:271
1150799476,26cyclictest0-21swapper/120:25:301
11507994719,17cyclictest1-21systemd22:11:111
11507994713,11cyclictest9450irq/48-DMA10:44:551
1150999468,35cyclictest0-21swapper/321:35:293
1150999468,35cyclictest0-21swapper/321:35:293
1150999461,5cyclictest128-21systemd-journal22:21:473
1150999461,5cyclictest128-21systemd-journal22:21:473
1150999461,5cyclictest1232-21/usr/sbin/munin23:10:253
1150999461,5cyclictest1232-21/usr/sbin/munin23:10:253
1150999461,10cyclictest7950irq/56-dwc_otg_23:34:533
11508994622,13cyclictest2065-21taskset20:11:462
11508994620,11cyclictest891-21chrt23:09:072
1150799466,25cyclictest0-21swapper/100:10:281
11508994533,8cyclictest11995-21apt-get22:10:262
11508994520,16cyclictest0-21swapper/221:57:472
11507994517,15cyclictest23812-21chrt19:43:461
11507994512,11cyclictest0-21swapper/123:10:341
11507994512,11cyclictest0-21swapper/123:10:341
11508994431,10cyclictest14008-21/usr/sbin/munin22:15:302
1150799447,25cyclictest0-21swapper/122:30:201
1150799447,24cyclictest0-21swapper/121:00:291
1150799447,24cyclictest0-21swapper/121:00:291
11507994420,14cyclictest26236-21taskset00:17:471
11507994412,12cyclictest9322-21chrt20:31:561
109792442,13sleep00-21swapper/019:06:570
11508994329,12cyclictest30515-21sed20:00:412
1150799436,24cyclictest0-21swapper/121:30:281
11507994315,12cyclictest21982-21taskset19:38:201
11507994315,12cyclictest21982-21taskset19:38:201
11507994313,14cyclictest29254-21chrt21:25:541
11507994311,9cyclictest7950irq/56-dwc_otg_19:25:351
1150799428,9cyclictest0-21swapper/123:35:151
1150799427,25cyclictest0-21swapper/119:55:281
1150799426,23cyclictest16229-21ls20:50:401
11507994215,9cyclictest7950irq/56-dwc_otg_22:15:411
11507994214,17cyclictest8094-21seq22:00:061
1150999412,5cyclictest0-21swapper/320:19:453
11507994114,12cyclictest31958-21date00:35:151
11507994112,9cyclictest0-21swapper/120:42:081
1150799405,13cyclictest114150lldpd20:37:561
1150799403,23cyclictest0-21swapper/123:06:551
11507994020,10cyclictest1124-21snmpd22:46:531
11507994012,18cyclictest0-21swapper/121:39:031
11507994012,18cyclictest0-21swapper/121:39:031
1150999393,23cyclictest7850irq/56-dwc_otg_21:55:153
11507993927,10cyclictest2019-21sshd20:11:111
11507993915,11cyclictest27443-21chrt19:53:521
11507993912,16cyclictest4085-21seq20:19:191
11507993911,17cyclictest30879-21chrt20:01:371
11507993823,12cyclictest5164-21fschecks_time23:20:331
11507993811,12cyclictest0-21swapper/121:54:491
11507993810,12cyclictest7850irq/56-dwc_otg_23:51:371
1150999371,23cyclictest7950irq/56-dwc_otg_00:10:283
1150799379,9cyclictest7950irq/56-dwc_otg_22:44:081
11509993617,6cyclictest24859-21/usr/sbin/munin00:15:393
11507993620,13cyclictest14375-21ls20:45:401
1150999341,9cyclictest29618-21ls21:30:143
103442346,19sleep110382-21ntp_offset19:05:361
1150999338,7cyclictest7850irq/56-dwc_otg_23:20:313
1150999332,16cyclictest7750irq/56-dwc_otg22:25:433
1150999331,22cyclictest13561-21latency_hist22:15:153
1150999322,5cyclictest7850irq/56-dwc_otg_20:00:413
1150999315,6cyclictest7950irq/56-dwc_otg_22:55:363
1150999314,9cyclictest7850irq/56-dwc_otg_19:15:253
1150999313,14cyclictest7950irq/56-dwc_otg_19:35:153
106222310,4sleep2301ktimersoftd/219:05:402
1150999307,6cyclictest7850irq/56-dwc_otg_00:30:293
1150999307,4cyclictest7750irq/56-dwc_otg23:52:063
1150999306,7cyclictest7850irq/56-dwc_otg_21:00:403
1150999306,7cyclictest7850irq/56-dwc_otg_21:00:403
1150999306,4cyclictest7750irq/56-dwc_otg19:40:253
1150999305,8cyclictest7750irq/56-dwc_otg20:20:283
1150999305,8cyclictest7750irq/56-dwc_otg20:20:283
1150999305,5cyclictest7750irq/56-dwc_otg00:40:143
1150999303,19cyclictest0-21swapper/319:25:273
1150999303,12cyclictest9826-21/usr/sbin/munin20:35:293
1150999301,14cyclictest7950irq/56-dwc_otg_22:45:353
1150999301,10cyclictest7750irq/56-dwc_otg23:25:343
11509993010,4cyclictest7750irq/56-dwc_otg23:47:113
1150999293,3cyclictest0-21swapper/323:55:333
1150999293,12cyclictest0-21swapper/321:33:443
1150999292,19cyclictest0-21swapper/319:54:583
1150999291,5cyclictest6787-21memory20:25:373
1150999284,10cyclictest7750irq/56-dwc_otg00:20:343
1150999282,16cyclictest0-21swapper/320:14:143
1150999281,19cyclictest0-21swapper/319:55:503
1150999281,12cyclictest7950irq/56-dwc_otg_20:45:423
1150999275,11cyclictest7950irq/56-dwc_otg_20:08:423
1150999274,5cyclictest7750irq/56-dwc_otg23:15:323
1150999271,3cyclictest7750irq/56-dwc_otg20:40:453
1150999264,4cyclictest19220-21/usr/sbin/munin22:30:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional