You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 05:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Wed Mar 25, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1152189910813,67cyclictest145367-21apt-get22:05:022
11521799742,39cyclictest0-21swapper/123:15:011
115217997148,16cyclictest231ktimers/120:55:011
11521899701,62cyclictest140493-21/usr/sbin/munin21:35:192
115218996825,37cyclictest0-21swapper/220:20:012
115214996427,33cyclictest0-21swapper/022:10:300
115218996320,35cyclictest0-21swapper/221:25:282
115218996320,35cyclictest0-21swapper/221:25:282
115218996216,39cyclictest1660-21snmpd00:03:322
11521799612,28cyclictest0-21swapper/123:20:011
115218995927,27cyclictest166640-21grep00:05:292
115218995927,27cyclictest166640-21grep00:05:292
11521899591,50cyclictest142826-21cron21:50:002
11521799592,21cyclictest135146-21apt-get21:05:011
115218995831,23cyclictest0-21swapper/222:30:282
115218995830,21cyclictest0-21swapper/219:30:282
11521899581,15cyclictest154178-21apt-get22:55:162
11521499581,43cyclictest0-21swapper/023:10:010
115218995720,29cyclictest0-21swapper/223:30:292
115218995719,30cyclictest0-21swapper/219:35:282
115218995714,34cyclictest0-21swapper/222:50:302
11521899571,14cyclictest149038-21apt-get22:25:162
115218995710,42cyclictest160724-21apt-get23:35:022
11521899564,41cyclictest148313-21fschecks_count22:20:182
11521899562,4cyclictest132181-21meminfo20:45:232
11521899561,9cyclictest157158-21/usr/sbin/munin23:10:262
115218995619,29cyclictest0-21swapper/221:10:302
115218995612,36cyclictest0-21swapper/223:55:282
115218995610,36cyclictest0-21swapper/220:25:182
115218995610,36cyclictest0-21swapper/220:25:182
115218995516,30cyclictest0-21swapper/221:00:282
11521899551,10cyclictest162790-21/usr/sbin/munin23:45:182
11521799551,33cyclictest0-21swapper/123:45:021
11521499552,5cyclictest157126-21ptp4l23:10:260
11521899544,41cyclictest168321-21sed00:15:302
11521899542,7cyclictest122505-21apt-get19:50:162
115218995416,29cyclictest0-21swapper/220:30:302
11521499541,26cyclictest0-21swapper/000:20:000
11521899536,38cyclictest0-21swapper/223:30:022
11521899536,38cyclictest0-21swapper/223:30:022
11521899533,41cyclictest144469-21head21:55:292
115218995329,19cyclictest133348-21grep20:50:282
11521899532,3cyclictest143089-21/usr/sbin/munin21:50:172
11521899532,11cyclictest152412-21apt-get22:45:162
115218995319,26cyclictest141475-21sh21:40:202
11521899531,8cyclictest131299-21/usr/sbin/munin20:40:222
11521899531,8cyclictest118449-21/usr/sbin/munin19:25:222
115218995316,30cyclictest0-21swapper/223:40:222
11521899528,36cyclictest147972-21cron22:19:592
11521899521,8cyclictest157867-21/usr/sbin/munin23:15:232
115218995213,31cyclictest0-21swapper/200:35:282
11521899521,11cyclictest170313-21apt-get00:30:142
11521899521,10cyclictest151881-21/usr/sbin/munin22:40:272
115217995243,5cyclictest0-21swapper/120:50:011
11521799524,32cyclictest24-21ksoftirqd/119:30:001
115214995234,15cyclictest167350irq/118-8000000.ethernet-tx021:55:170
11521499521,34cyclictest0-21swapper/022:40:020
11521899515,5cyclictest123926-21grep19:55:272
11521899515,36cyclictest0-21swapper/221:15:282
11521899512,9cyclictest126409-21grep20:10:302
11521899512,6cyclictest117061-21grep19:15:282
11521899512,6cyclictest117061-21grep19:15:282
11521899512,10cyclictest135538-21lsblk21:05:222
11521899511,9cyclictest164114-21/usr/sbin/munin23:50:272
11521899511,9cyclictest133969-21/usr/sbin/munin20:55:232
115218995111,34cyclictest122263-21unixbench_singl19:45:292
115218995111,34cyclictest122263-21unixbench_singl19:45:292
11521899511,12cyclictest125041-21apt-get20:05:152
11521899511,10cyclictest124564-21/usr/sbin/munin20:00:272
11521799511,31cyclictest0-21swapper/121:00:001
11521499511,19cyclictest0-21swapper/023:30:010
11521499511,19cyclictest0-21swapper/023:30:010
11521899503,6cyclictest150903-21cut22:35:212
11521899502,8cyclictest158857-21/usr/sbin/munin23:20:272
11521899502,8cyclictest156432-21grep23:05:282
11521899502,13cyclictest137979-21apt-get21:20:152
11521899501,8cyclictest130411-21/usr/sbin/munin20:35:222
115218995015,27cyclictest0-21swapper/200:10:312
11521899501,43cyclictest128285-21sshd20:21:242
11521799501,11cyclictest0-21swapper/123:10:011
115214995044,2cyclictest0-21swapper/022:50:120
11521899494,7cyclictest115904-21tail19:10:292
11521899493,38cyclictest139750-21cut21:30:192
11521899491,8cyclictest169892-21/usr/sbin/munin00:25:272
11521799491,32cyclictest0-21swapper/100:05:001
115214994933,14cyclictest167350irq/118-8000000.ethernet-tx022:00:250
11521899489,31cyclictest146560-21dropbear22:10:192
11521899482,7cyclictest155388-21/usr/sbin/munin23:00:252
11521899481,9cyclictest117415-21/usr/sbin/munin19:20:152
115218994816,29cyclictest0-21swapper/219:40:162
11521499481,45cyclictest0-21swapper/019:35:060
11521899473,5cyclictest145728-21/usr/sbin/munin22:05:202
11521899471,11cyclictest169089-21/usr/sbin/munin00:20:272
115217994730,9cyclictest0-21swapper/119:50:001
115217994730,9cyclictest0-21swapper/119:50:001
11521799471,33cyclictest0-21swapper/122:15:021
11521499473,8cyclictest0-21swapper/021:50:180
115214994729,15cyclictest167350irq/118-8000000.ethernet-tx000:40:010
11521499471,5cyclictest142745-21tail21:45:300
11521499471,4cyclictest154331-21fschecks_time22:55:200
11521499471,32cyclictest0-21swapper/019:30:020
115214994710,5cyclictest135313-21rm21:05:020
11521799462,27cyclictest0-21swapper/100:15:011
11521499466,22cyclictest15-21rcuc/000:00:020
115214994639,4cyclictest167350irq/118-8000000.ethernet-tx000:05:220
115214994639,4cyclictest167350irq/118-8000000.ethernet-tx000:05:220
115217994537,5cyclictest141138-21munin-plugin-st21:40:001
115214994538,4cyclictest167350irq/118-8000000.ethernet-tx022:45:200
115214994538,4cyclictest167350irq/118-8000000.ethernet-tx020:50:180
11521499452,18cyclictest0-21swapper/022:20:010
11521499451,7cyclictest0-21swapper/020:25:020
11521499451,41cyclictest127473-21cat20:20:020
11521499451,38cyclictest131805-21wc20:45:010
11521899444,30cyclictest0-21swapper/219:10:022
115217994433,7cyclictest130791-21grep20:35:301
115217994430,10cyclictest0-21swapper/119:35:011
115214994433,8cyclictest158196-21munin-run23:20:010
115214994426,16cyclictest0-21swapper/020:25:170
115214994426,16cyclictest0-21swapper/020:25:170
11521499442,4cyclictest0-21swapper/021:35:010
11521499441,40cyclictest124813-21users20:00:290
115217994324,12cyclictest231ktimers/100:30:121
115214994336,4cyclictest20650irq/252-8000000.ethernet23:20:120
11521499432,9cyclictest15-21rcuc/000:30:010
11521499431,38cyclictest0-21swapper/022:45:000
115217994232,5cyclictest0-21swapper/100:35:281
11521499424,25cyclictest160811-21cmp23:35:000
115214994235,4cyclictest167350irq/118-8000000.ethernet-tx023:35:150
115214994235,4cyclictest167350irq/118-8000000.ethernet-tx000:30:160
11521499421,5cyclictest126197-21awk20:10:290
115214994214,6cyclictest131ktimers/000:10:140
11521499421,39cyclictest0-21swapper/023:40:220
11521499421,12cyclictest0-21swapper/019:15:010
11521499421,12cyclictest0-21swapper/019:15:010
11521799412,16cyclictest0-21swapper/120:45:021
11521799411,3cyclictest0-21swapper/122:45:001
11521499412,5cyclictest123640-21meminfo19:55:220
11521499412,36cyclictest134280-21kworker/dying21:10:230
11521499411,26cyclictest0-21swapper/019:55:000
115217994020,13cyclictest231ktimers/119:50:131
115214994035,4cyclictest0-21swapper/021:25:190
115214994035,4cyclictest0-21swapper/021:25:180
115214994034,3cyclictest132558-21apt-config20:50:010
115214994033,3cyclictest125107-21df_inode20:05:180
115214994030,5cyclictest20650irq/252-8000000.ethernet21:40:280
115214994027,9cyclictest0-21swapper/020:35:270
11521499402,35cyclictest0-21swapper/021:20:180
115214994023,15cyclictest200-21pr/ttyS223:50:000
115217993932,4cyclictest121466-21munin-plugin-st19:45:001
115217993930,5cyclictest0-21swapper/100:25:301
115217993927,7cyclictest0-21swapper/120:15:251
11521799391,17cyclictest14-21rcu_preempt20:05:021
115214993929,7cyclictest47-21kauditd21:19:590
115214993922,9cyclictest0-21swapper/000:05:010
115214993922,14cyclictest0-21swapper/023:00:220
115217993830,4cyclictest167450irq/126-8000000.ethernet-tx122:00:291
115217993827,7cyclictest0-21swapper/120:20:281
115217993827,6cyclictest137647-21grep21:15:281
11521799381,4cyclictest0-21swapper/123:35:021
11521799381,2cyclictest0-21swapper/122:40:011
11521499381,3cyclictest0-21swapper/020:35:000
11521499381,35cyclictest0-21swapper/022:25:170
11521499381,35cyclictest0-21swapper/022:05:040
11521499381,35cyclictest0-21swapper/021:05:280
11521499381,35cyclictest0-21swapper/019:10:290
115217993730,4cyclictest155667-21cron23:05:011
115217993729,5cyclictest164928-21unixbench_multi23:55:281
115214993732,3cyclictest0-21swapper/023:50:140
11521499371,4cyclictest0-21swapper/019:25:010
11521499371,34cyclictest0-21swapper/020:55:150
11521499371,2cyclictest119042-21apt-get19:30:140
115217993629,4cyclictest167450irq/126-8000000.ethernet-tx122:50:251
115217993629,4cyclictest0-21swapper/121:05:201
115217993627,5cyclictest0-21swapper/122:05:191
115217993623,5cyclictest0-21swapper/122:30:261
115217993619,12cyclictest231ktimers/121:45:141
11521799361,2cyclictest0-21swapper/119:20:021
115214993625,8cyclictest0-21swapper/000:20:260
115217993526,5cyclictest0-21swapper/122:55:211
115217993526,5cyclictest0-21swapper/122:25:291
11521799352,24cyclictest0-21swapper/121:25:011
11521499351,4cyclictest0-21swapper/022:30:160
11521499351,4cyclictest0-21swapper/022:20:200
11521499351,32cyclictest0-21swapper/021:38:580
115217993427,3cyclictest0-21swapper/120:05:291
115217993426,5cyclictest0-21swapper/119:10:281
115217993423,7cyclictest126482-21grep20:10:311
115217993416,13cyclictest231ktimers/100:20:151
115214993429,3cyclictest0-21swapper/019:45:260
115214993429,3cyclictest0-21swapper/019:45:260
11521799333,24cyclictest14-21rcu_preempt21:50:231
11521799332,5cyclictest0-21swapper/121:10:011
115217993317,8cyclictest0-21swapper/121:40:201
11521799331,5cyclictest0-21swapper/100:05:011
11521799331,5cyclictest0-21swapper/100:05:011
11521799331,27cyclictest0-21swapper/119:35:261
115214993324,6cyclictest131ktimers/019:40:260
115217993226,4cyclictest0-21swapper/123:50:261
115217993224,5cyclictest0-21swapper/119:55:281
115217993223,5cyclictest0-21swapper/100:15:301
115217993222,6cyclictest0-21swapper/121:30:271
11521799321,26cyclictest0-21swapper/123:30:231
115217993123,5cyclictest0-21swapper/123:20:281
11521799311,12cyclictest8321systemd-network20:30:231
115217993013,10cyclictest231ktimers/121:25:131
115217993013,10cyclictest231ktimers/121:25:131
11521799301,24cyclictest0-21swapper/119:16:111
11521799301,24cyclictest0-21swapper/119:16:111
115217992919,6cyclictest0-21swapper/123:45:291
115217992917,8cyclictest147870-21grep22:15:281
115217992912,4cyclictest167450irq/126-8000000.ethernet-tx122:47:051
115217992813,11cyclictest231ktimers/122:20:141
115217992619,5cyclictest0-21swapper/123:25:241
115217992619,5cyclictest0-21swapper/123:25:241
115217992616,5cyclictest0-21swapper/121:55:191
115217992611,9cyclictest128506-21/usr/sbin/munin20:25:181
115217992611,9cyclictest128506-21/usr/sbin/munin20:25:181
115214992413,9cyclictest115296-21latency_hist19:10:010
115217991914,3cyclictest115219-21latency_hist19:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional