You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 04:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Fri Mar 13, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37779949912740,1270cyclictest39075422sleep320:44:563
37779949911750,1171cyclictest41325732sleep323:14:573
37779949911580,1154cyclictest303672sleep300:14:553
37779949911510,1147cyclictest39490122sleep321:15:023
37779949911180,1114cyclictest40407922sleep322:15:013
41687452211,10sleep04168888-21netstat23:35:180
377799499181,13cyclictest3786049-21taskset19:15:023
39942322171,6sleep03941074-21diskmemload21:43:210
39621252171,5sleep03962269-21ntpq21:20:210
377799499178,5cyclictest4079115-21turbostat22:40:003
3777994991713,1cyclictest0-21swapper/319:50:203
377799499171,12cyclictest7477-21turbostat23:59:593
377799499171,12cyclictest46206-21taskset00:25:013
377799499171,12cyclictest3941108-21taskset21:10:003
377799499165,7cyclictest3963597-21taskset21:23:073
377799499161,8cyclictest0-21swapper/300:39:343
377799499158,3cyclictest39485122sleep321:14:063
377799499156,7cyclictest3987019-21turbostat21:39:593
377799499155,7cyclictest4152025-21taskset23:25:193
377799499155,7cyclictest3921150-21turbostat20:59:553
377799499155,6cyclictest541942sleep300:30:123
377799499151,9cyclictest41176102sleep323:05:113
3777994991513,1cyclictest0-21swapper/320:16:513
3777994991513,0cyclictest0-21swapper/323:41:433
3777994991513,0cyclictest0-21swapper/322:59:063
3777994991512,1cyclictest0-21swapper/323:49:203
3777994991512,1cyclictest0-21swapper/323:37:543
3777994991512,1cyclictest0-21swapper/322:53:023
3777994991512,1cyclictest0-21swapper/322:02:453
3777994991512,1cyclictest0-21swapper/321:31:193
3777994991512,1cyclictest0-21swapper/320:30:203
3777994991512,1cyclictest0-21swapper/320:14:583
3777994991512,1cyclictest0-21swapper/320:14:573
3777994991512,1cyclictest0-21swapper/319:47:513
3777994991512,1cyclictest0-21swapper/319:39:073
3777994991512,1cyclictest0-21swapper/319:11:463
3777994991512,1cyclictest0-21swapper/300:09:303
377799499151,11cyclictest4056164-21taskset22:24:593
377799499151,11cyclictest4002512-21taskset21:50:003
377799499151,10cyclictest30713-21taskset00:15:113
173198150,5rtkit-daemon3777010-21ntp_states19:05:222
377799499144,7cyclictest38742662sleep320:20:143
377799499144,6cyclictest38463842sleep319:55:223
377799499142,9cyclictest4025635-21chrt22:05:123
377799499141,9cyclictest4155863-21taskset23:30:113
377799499141,9cyclictest39644022sleep321:25:133
377799499141,9cyclictest3928443-21taskset21:00:163
377799499141,9cyclictest13596-21taskset00:00:253
3777994991412,1cyclictest0-21swapper/323:17:303
3777994991412,0cyclictest0-21swapper/323:23:583
3777994991412,0cyclictest0-21swapper/322:28:573
3777994991412,0cyclictest0-21swapper/320:28:523
3777994991412,0cyclictest0-21swapper/300:22:483
3777994991411,1cyclictest0-21swapper/321:55:043
3777994991411,1cyclictest0-21swapper/319:25:463
3777994991411,1cyclictest0-21swapper/319:22:353
377799499141,10cyclictest4193779-21chrt23:55:013
377799499141,10cyclictest3824773-21taskset19:40:183
377799499141,10cyclictest3778112-21taskset19:10:003
377799499140,10cyclictest41155512sleep323:00:233
173198140,3rtkit-daemon4123231-21ntpq23:05:210
377799499135,6cyclictest40088002sleep321:50:293
377799499131,9cyclictest40870382sleep322:45:123
377799499131,9cyclictest3993804-21taskset21:41:473
377799499131,9cyclictest3914240-21taskset20:47:213
377799499131,9cyclictest3899941-21taskset20:35:273
377799499131,9cyclictest3807344-21taskset19:30:043
3777994991311,1cyclictest0-21swapper/322:30:273
3777994991311,1cyclictest0-21swapper/322:30:263
39306422121,8sleep13932797-21cut21:00:191
38817302121,5sleep23882319-21kthreadcore20:25:172
377799499129,1cyclictest0-21swapper/320:00:163
377799499124,6cyclictest3914702-21taskset20:50:093
377799499121,8cyclictest4079398-21taskset22:40:093
377799499121,8cyclictest38581802sleep320:05:183
377799499120,9cyclictest4033198-21taskset22:10:093
297772125,1sleep2171rcu_preempt00:12:432
173198120,8rtkit-daemon4162658-21ssh23:33:092
173198120,4rtkit-daemon171rcu_preempt21:47:350
41405262112,5sleep14140559-21apt-get23:20:121
40486942110,6sleep24048183-21apt-get22:20:022
39638792111,7sleep13941074-21diskmemload21:24:101
38412842111,7sleep23841467-21cut19:55:172
173198110,7rtkit-daemon3948175-21ssh21:12:511
173198110,7rtkit-daemon3946968-21gcc21:10:212
173198110,6rtkit-daemon3859783-21ntpq20:05:212
173198110,6rtkit-daemon3827407-21/usr/sbin/munin19:45:002
173198110,3rtkit-daemon4185561-21ssh23:48:192
154882110,4sleep215544-21cpuspeed_turbos00:05:152
40773912101,6sleep04077517-21python322:35:230
40703132102,2sleep2171rcu_preempt22:30:452
40703132102,2sleep2171rcu_preempt22:30:442
40619932100,2sleep04062046-21ntpq22:25:210
40332072102,4sleep14033242-21apt-get22:10:121
39796662101,6sleep03979669-21apt-get21:35:110
39161042100,1sleep20-21swapper/220:50:172
39147252100,1sleep10-21swapper/120:50:121
38997772100,8sleep13899856-21ps20:35:261
38464852101,5sleep13846531-21ntpq19:55:231
173198100,5rtkit-daemon4132892-21acpi23:15:120
173198100,5rtkit-daemon4107920-21ntpq22:55:220
173198100,5rtkit-daemon3879812-21ntp_states20:20:252
173198100,5rtkit-daemon3814436-21df_inode19:35:122
173198100,5rtkit-daemon36261-21ntpq00:15:210
173198100,4rtkit-daemon3784663-21grep19:15:002
59713291,4sleep059763-21ntpq00:30:200
4165200291,2sleep20-21swapper/223:35:162
4116167291,6sleep20-21swapper/223:00:382
4111371290,6sleep14112391-21cat23:00:171
4069694291,5sleep14069736-21ntpq22:30:231
4069694291,5sleep14069736-21ntpq22:30:221
4010316291,4sleep24010338-21apt-get21:55:142
4009579290,6sleep14009583-21ssh21:53:231
3994990291,4sleep23994992-21apt-get21:45:112
3993940291,5sleep13993942-21ssh21:42:181
3956913290,7sleep23956713-21/usr/sbin/munin21:20:142
3946975291,5sleep03947027-21ntp_states21:10:220
3933551292,4sleep23933593-21ntpq21:00:242
3861241291,5sleep13861482-21irqcore20:10:141
3861241291,5sleep13861482-21irqcore20:10:141
3834318291,4sleep23834351-21apt-get19:50:112
3814247291,4sleep03814280-21apt-get19:35:110
3812830291,5sleep03812879-21ntpq19:30:220
30678291,4sleep230710-21apt-get00:15:112
17319890,5rtkit-daemon4171108-21apt-get23:40:122
17319890,4rtkit-daemon4085749-21ssh22:41:182
17319890,4rtkit-daemon4005349-21cut21:50:170
17319890,4rtkit-daemon3791732-21tr19:15:192
17319890,3rtkit-daemon3784796-21munin-node19:30:432
17319890,2rtkit-daemon3955351-21ssh21:16:001
5533280,4sleep25625-21ntpq23:55:212
4184250280,5sleep14184280-21ssh23:45:211
4161782280,5sleep04161933-21users23:30:260
4153733281,4sleep24153790-21grep23:25:232
4131399281,4sleep03941074-21diskmemload23:10:250
4125260281,4sleep14125295-21apt-get23:10:101
4110375280,4sleep04111370-21irqstats23:00:160
4093822280,5sleep14093826-21ssh22:47:551
4092473280,5sleep04092568-21ntpq22:45:210
4085195280,5sleep04085308-21/usr/sbin/munin22:40:230
3985173281,4sleep13985226-21ntpq21:35:201
3972039282,3sleep13972061-21apt-get21:30:121
3970179281,4sleep03970377-21/usr/sbin/munin21:25:250
3922284281,4sleep13923223-21grep20:55:171
3907546281,4sleep23907565-21munin-run20:45:002
3847647281,4sleep03847680-21apt-get20:00:110
3834502281,4sleep03834590-21tune2fs19:50:130
3787024281,3sleep13787057-21apt-get19:15:131
17319880,5rtkit-daemon649-21ntpd22:13:552
17319880,4rtkit-daemon72-21kcompactd022:17:302
17319880,4rtkit-daemon647-21lldpd20:01:142
17319880,4rtkit-daemon53668-21apt-get00:30:012
17319880,4rtkit-daemon453-21wpa_supplicant21:56:320
17319880,4rtkit-daemon453-21wpa_supplicant20:59:580
17319880,4rtkit-daemon453-21wpa_supplicant20:38:282
17319880,4rtkit-daemon4192782-21ssh23:51:441
17319880,4rtkit-daemon4152702-21cut23:25:180
17319880,4rtkit-daemon3977547-21ntpq21:30:210
17319880,4rtkit-daemon3940207-21ntpq21:05:220
17319880,3rtkit-daemon643-21snmpd00:20:210
17319880,1rtkit-daemon0-21swapper/220:13:172
17319880,1rtkit-daemon0-21swapper/220:13:162
17319880,1rtkit-daemon0-21swapper/219:49:522
17319880,1rtkit-daemon0-21swapper/219:21:482
14658281,4sleep114662-21ssh00:03:121
63293270,4sleep064499-21kthreadcore00:35:180
5685270,5sleep00-21swapper/023:55:230
54147270,3sleep154149-21ssh00:30:011
47095270,4sleep047986-21grep00:25:200
4191827270,4sleep04191878-21ntpq23:50:210
4171075271,2sleep00-21swapper/023:40:120
4155412270,1sleep10-21swapper/123:29:351
4144762270,4sleep04145933-21memory23:20:190
4124963270,2sleep14124967-21ssh23:09:581
4109329271,3sleep24109331-21ssh22:58:412
4100168271,3sleep24100196-21ssh22:50:192
4070675270,1sleep00-21swapper/022:32:100
4070675270,1sleep00-21swapper/022:32:100
4040869270,4sleep04040943-21sort22:15:110
4031197270,4sleep1643-21snmpd22:05:221
4024767271,2sleep10-21swapper/122:02:571
4021085270,4sleep24023231-21cut22:00:182
4002638270,4sleep24002641-21apt-get21:50:122
3867320270,1sleep00-21swapper/020:14:540
3867320270,1sleep00-21swapper/020:14:530
3853997270,1sleep10-21swapper/120:04:411
3841010271,3sleep03841165-21diskstats19:55:140
3820995270,3sleep13820998-21apt-get19:40:121
3801611270,4sleep03802777-21grep19:25:160
22532270,2sleep122536-21ssh00:09:061
17319870,4rtkit-daemon647-21lldpd22:35:582
17319870,4rtkit-daemon647-21lldpd22:09:582
17319870,4rtkit-daemon500-21gmain22:02:540
17319870,4rtkit-daemon13967-21ssh00:00:352
17319870,3rtkit-daemon68930-21ssh00:38:481
17319870,3rtkit-daemon67473-21ntpq00:35:222
17319870,3rtkit-daemon643-21snmpd21:25:181
17319870,3rtkit-daemon643-21snmpd21:07:352
17319870,3rtkit-daemon643-21snmpd20:56:362
17319870,3rtkit-daemon643-21snmpd19:25:202
17319870,3rtkit-daemon53423-21ssh00:29:062
17319870,3rtkit-daemon500-21gmain20:47:382
17319870,3rtkit-daemon435-21avahi-daemon22:50:200
17319870,3rtkit-daemon4191888-21ntpq23:50:222
17319870,1rtkit-daemon0-21swapper/222:28:252
44951261,3sleep144953-21ssh00:22:131
4184195260,4sleep04184249-21/usr/sbin/munin23:45:200
4177621260,4sleep14177625-21ssh23:42:131
4169881260,1sleep10-21swapper/123:36:431
4139591260,4sleep24139595-21ssh23:17:412
4138225260,3sleep14138360-21ssh23:15:201
4132587260,3sleep24132610-21awk23:15:012
4089999260,3sleep24092093-21cut22:45:192
4081287260,3sleep14083217-21grep22:40:161
4072755261,2sleep10-21swapper/122:35:161
4055865261,1sleep10-21swapper/122:23:531
4054599260,4sleep04054657-21switchtime22:20:240
4040029260,3sleep00-21swapper/022:13:030
4001695260,2sleep10-21swapper/121:47:391
3985636260,3sleep23985770-21sh21:35:252
3950442261,2sleep00-21swapper/021:15:160
3929414260,3sleep03930641-21grep21:00:170
3921043260,1sleep00-21swapper/020:53:560
3900715260,3sleep03900631-21apt-get20:40:010
3891637260,3sleep03892861-21memory20:30:190
3887587261,2sleep10-21swapper/120:30:121
3833942260,1sleep00-21swapper/019:48:250
3811571260,4sleep13807354-21/usr/sbin/munin19:30:191
3774407260,2sleep00-21swapper/019:05:180
28561260,3sleep13941074-21diskmemload00:10:221
17319860,3rtkit-daemon649-21ntpd22:05:360
17319860,3rtkit-daemon649-21ntpd20:30:102
17319860,3rtkit-daemon643-21snmpd00:14:510
17319860,3rtkit-daemon3784796-21munin-node20:15:012
7006250,3sleep17010-21ssh23:58:201
4122717250,2sleep20-21swapper/223:05:182
4100936251,2sleep10-21swapper/122:50:541
4058739250,3sleep14060780-21grep22:25:181
4048021250,2sleep10-21swapper/122:19:201
3993744251,2sleep20-21swapper/221:41:352
3973423251,2sleep23974125-21ssh21:30:172
3934940250,1sleep10-21swapper/121:05:151
3914421250,1sleep00-21swapper/020:49:390
3907330250,1sleep10-21swapper/120:42:151
3900331250,3sleep03900332-21sshd20:36:220
3880908250,2sleep10-21swapper/120:25:121
3875678251,2sleep10-21swapper/120:20:201
3855181250,3sleep13856086-21kthreadcore20:05:161
3854278251,1sleep03854311-21apt-get20:05:110
38541251,2sleep20-21swapper/200:20:132
3821282251,2sleep03821680-21irqcore19:40:150
3815461251,2sleep10-21swapper/119:35:151
3802778251,1sleep10-21swapper/119:25:171
3800325250,1sleep00-21swapper/019:23:290
3793286250,1sleep00-21swapper/019:17:390
3784366250,1sleep00-21swapper/019:11:500
3778161250,2sleep10-21swapper/119:10:111
22351250,3sleep00-21swapper/000:08:240
17319850,1rtkit-daemon0-21swapper/123:30:151
46350240,1sleep10-21swapper/100:25:161
4147022240,2sleep24147026-21ssh23:21:372
4102331240,2sleep10-21swapper/122:55:111
4016606240,1sleep10-21swapper/121:56:091
3970877240,2sleep23970879-21ssh21:26:472
3948800240,2sleep20-21swapper/221:15:022
3908057240,2sleep10-21swapper/120:45:111
3886782240,1sleep00-21swapper/020:25:280
3880459240,2sleep00-21swapper/020:22:310
3869115240,2sleep03871151-21grep20:15:170
3867780240,1sleep10-21swapper/120:15:141
3833205240,2sleep10-21swapper/119:45:221
3771744240,1sleep10-21swapper/119:05:151
36923240,2sleep136927-21ssh00:15:511
7725230,1sleep00-21swapper/000:00:030
3839480230,1sleep10-21swapper/119:50:181
3793529230,1sleep10-21swapper/119:20:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional