You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 10:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Wed Dec 17, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35619699912671,1261cyclictest3622060-21sleep19:55:003
35619699912200,1215cyclictest3873767-21sleep23:10:013
35619699912110,1207cyclictest3589715-21sleep19:30:003
3561969999770,973cyclictest3841626-21sleep22:45:003
3561969992219,1cyclictest0-21swapper/321:35:003
3561969992017,1cyclictest0-21swapper/322:00:003
3561969991916,1cyclictest0-21swapper/300:00:003
3561969991910,7cyclictest37194052sleep321:10:173
3561969991714,1cyclictest0-21swapper/323:40:003
3561969991714,1cyclictest0-21swapper/319:45:013
3561969991714,1cyclictest0-21swapper/319:19:593
3561969991614,1cyclictest0-21swapper/320:20:013
3561969991613,1cyclictest0-21swapper/323:25:153
3561969991613,1cyclictest0-21swapper/322:55:203
356196999160,13cyclictest3822305-21taskset22:30:013
356196999157,5cyclictest3983208-21turbostat00:34:593
356196999155,7cyclictest36937152sleep320:50:173
3561969991513,1cyclictest0-21swapper/321:46:373
3561969991512,1cyclictest0-21swapper/322:02:113
3561969991512,1cyclictest0-21swapper/321:00:013
3561969991512,1cyclictest0-21swapper/300:29:493
356196999151,11cyclictest3731782-21taskset21:20:013
356196999151,10cyclictest38028602sleep322:15:123
356196999144,7cyclictest3957245-21taskset00:11:423
356196999141,9cyclictest3848330-21chrt22:50:123
3561969991413,0cyclictest0-21swapper/323:19:173
3561969991413,0cyclictest0-21swapper/322:05:053
3561969991412,1cyclictest0-21swapper/323:50:013
3561969991412,1cyclictest0-21swapper/323:43:433
3561969991412,0cyclictest0-21swapper/323:23:373
3561969991412,0cyclictest0-21swapper/320:25:313
3561969991411,1cyclictest0-21swapper/320:24:293
3561969991411,1cyclictest0-21swapper/320:24:283
3561969991411,1cyclictest0-21swapper/300:00:193
356196999141,10cyclictest3963912-21turbostat00:19:593
356196999141,10cyclictest3776991-21turbostat21:55:003
356196999141,10cyclictest3692798-21chrt20:47:113
356196999141,10cyclictest3680121-21chrt20:40:033
356196999141,10cyclictest3641519-21taskset20:10:013
356196999141,10cyclictest3641296-21turbostat20:10:003
356196999141,10cyclictest3622323-21taskset19:55:103
356196999141,10cyclictest3609432-21chrt19:45:013
35566572140,3sleep30-21swapper/319:05:153
39790982130,6sleep03981219-21tr00:30:180
356196999132,7cyclictest39255832sleep323:50:103
356196999131,9cyclictest3867022-21taskset23:01:063
356196999131,9cyclictest3829194-21chrt22:35:133
356196999131,9cyclictest3821492-21taskset22:26:003
356196999131,9cyclictest3751983-21taskset21:35:163
356196999131,9cyclictest3678877-21taskset20:35:183
356196999131,9cyclictest3583000-21chrt19:20:583
3561969991311,1cyclictest0-21swapper/322:45:023
3561969991311,1cyclictest0-21swapper/322:45:013
3561969991311,1cyclictest0-21swapper/321:40:153
3561969991311,1cyclictest0-21swapper/321:27:193
3561969991311,1cyclictest0-21swapper/319:38:293
356196999131,10cyclictest3634690-21taskset20:02:493
3561969991310,1cyclictest0-21swapper/321:07:123
3561969991310,1cyclictest0-21swapper/319:11:503
3561969991310,1cyclictest0-21swapper/300:07:053
356196999130,10cyclictest3905822-21taskset23:34:443
356196999130,10cyclictest3667237-21taskset20:30:013
38043172121,9sleep03805770-21kthreadcore22:15:170
37963862120,2sleep2421rcuc/222:10:012
356196999121,9cyclictest3815257-21taskset22:23:153
356196999121,9cyclictest3802412-21chrt22:12:303
356196999121,9cyclictest3737775-21taskset21:22:103
356196999121,8cyclictest3875116-21taskset23:10:163
3561969991210,1cyclictest0-21swapper/319:30:013
356196999120,9cyclictest3983443-21taskset00:35:063
356196999120,9cyclictest3706125-21chrt21:00:093
356196999120,10cyclictest3969984-21taskset00:20:313
301798120,5rtkit-daemon448-21wpa_supplicant00:34:001
36868302112,5sleep13686863-21apt-get20:45:111
301798110,4rtkit-daemon636-21snmpd22:35:372
301798110,4rtkit-daemon3205-21sendmail-mta21:21:322
301798110,3rtkit-daemon3568584-21munin-node20:27:372
39759102101,6sleep03975991-21sendmail_mailst00:25:220
39256202100,7sleep03925770-21/usr/sbin/munin23:50:110
39180612101,5sleep23918119-21ntp_states23:40:212
39065132100,7sleep23907245-21sed23:35:152
38471932101,6sleep03847267-21cut22:45:210
38471932101,6sleep03847267-21cut22:45:200
38290042101,5sleep13829037-21apt-get22:35:121
37902432101,6sleep13790341-21fschecks_time22:05:161
36089272101,6sleep13609187-21cmp19:45:011
35769002101,5sleep13577092-21latency_hist19:20:011
301798100,6rtkit-daemon3873999-21/usr/sbin/munin23:10:202
301798100,5rtkit-daemon3893412-21df_inode23:25:121
301798100,3rtkit-daemon636-21snmpd19:23:302
301798100,3rtkit-daemon3568584-21munin-node19:26:142
3988663290,6sleep13988768-21ntpq00:35:211
3886808291,4sleep03886841-21apt-get23:20:110
3860208290,6sleep03860444-21grep22:55:230
3786159291,5sleep03788317-21kthreadcore22:00:180
3758193290,6sleep13758393-21hddtemp_smartct21:40:151
3753353290,6sleep13755418-21grep21:35:191
3654434291,4sleep03654456-21apt-get20:20:140
3654434291,4sleep03654456-21apt-get20:20:140
30179890,5rtkit-daemon636-21snmpd20:59:382
30179890,5rtkit-daemon492-21gmain20:33:312
30179890,5rtkit-daemon0-21swapper/219:40:172
30179890,4rtkit-daemon448-21wpa_supplicant22:58:352
30179890,4rtkit-daemon3938110-21runrttasks23:59:071
30179890,4rtkit-daemon3835631-21df_inode22:40:132
30179890,4rtkit-daemon3826145-21cut22:30:182
30179890,4rtkit-daemon3562306-21df19:10:132
30179890,3rtkit-daemon492-21gmain19:58:392
30179890,3rtkit-daemon3523009-21munin-node19:09:502
30179890,1rtkit-daemon3016-21rtkit-daemon20:35:212
30179890,1rtkit-daemon0-21swapper/220:13:262
30179890,1rtkit-daemon0-21swapper/219:47:512
3957500281,4sleep03957594-21sort00:15:000
3950331280,4sleep03950398-21python300:05:220
3933040280,6sleep03934264-21grep23:55:170
3893222281,3sleep03893255-21apt-get23:25:110
3868566281,4sleep03869606-21cut23:05:170
3815685281,4sleep03815838-21df_inode22:25:130
3801602280,4sleep03801736-21awk22:10:190
3798604280,5sleep23800729-21cut22:10:182
3764445280,5sleep13764509-21ls21:45:131
3730684280,1sleep20-21swapper/221:15:202
3630216280,5sleep23632117-21grep20:00:152
3557126281,4sleep03558671-21cut19:05:170
30179880,5rtkit-daemon667-21lldpd00:17:361
30179880,5rtkit-daemon638-21ntpd22:18:162
30179880,4rtkit-daemon667-21lldpd21:42:422
30179880,4rtkit-daemon667-21lldpd19:15:272
30179880,4rtkit-daemon638-21ntpd22:20:122
30179880,4rtkit-daemon636-21snmpd22:03:132
30179880,4rtkit-daemon636-21snmpd21:05:272
30179880,4rtkit-daemon636-21snmpd00:29:441
30179880,4rtkit-daemon492-21gmain22:46:032
30179880,4rtkit-daemon492-21gmain22:46:032
30179880,4rtkit-daemon492-21gmain21:00:182
30179880,4rtkit-daemon3880383-21chrt23:15:072
30179880,4rtkit-daemon3620933-21/usr/sbin/munin19:50:192
30179880,4rtkit-daemon3568584-21munin-node20:50:342
30179880,4rtkit-daemon3568584-21munin-node20:23:562
30179880,4rtkit-daemon3568584-21munin-node20:23:552
30179880,4rtkit-daemon3568584-21munin-node20:15:472
30179880,4rtkit-daemon3200908-21packagekitd23:34:412
30179880,4rtkit-daemon3200908-21packagekitd23:00:212
30179880,3rtkit-daemon3954335-21cut00:10:171
30179880,3rtkit-daemon3764603-21diskstats21:45:132
30179880,1rtkit-daemon0-21swapper/223:47:122
30179880,1rtkit-daemon0-21swapper/221:52:172
30179880,1rtkit-daemon0-21swapper/100:20:131
3899702270,4sleep13899858-21diskstats23:30:141
3854732270,3sleep13854765-21apt-get22:55:111
3822326271,3sleep13822359-21apt-get22:30:121
3809258271,3sleep03809291-21apt-get22:20:130
3777240271,3sleep03777273-21apt-get21:55:120
3770826271,2sleep13770859-21apt-get21:50:131
3758036270,4sleep03758192-21diskstats21:40:150
3750742270,1sleep00-21swapper/021:30:520
3750184270,4sleep13750241-21awk21:30:211
3738124270,4sleep23738010-21apt-get21:25:022
3675101270,4sleep03676718-21kthreadcore20:35:150
3628726271,2sleep10-21swapper/120:00:101
3615628270,4sleep03615672-21munin-run19:50:010
3586014270,4sleep03588171-21kthreadcore19:25:200
3564171271,3sleep03566294-21cut19:10:180
3555867270,4sleep13556069-21sh19:05:131
30179870,4rtkit-daemon638-21ntpd21:35:332
30179870,3rtkit-daemon667-21lldpd20:41:422
30179870,3rtkit-daemon638-21ntpd19:30:152
30179870,3rtkit-daemon636-21snmpd23:50:571
30179870,3rtkit-daemon636-21snmpd23:21:521
30179870,3rtkit-daemon636-21snmpd22:25:432
30179870,3rtkit-daemon636-21snmpd19:38:052
30179870,3rtkit-daemon3568584-21munin-node23:50:002
30179870,3rtkit-daemon3568584-21munin-node21:57:032
30179870,3rtkit-daemon3568584-21munin-node00:07:551
30179870,3rtkit-daemon3205-21sendmail-mta22:50:322
30179870,3rtkit-daemon3205-21sendmail-mta20:05:382
30179870,3rtkit-daemon3205-21sendmail-mta00:03:171
30179870,3rtkit-daemon3200908-21packagekitd20:45:032
30179870,3rtkit-daemon2904-21cron21:33:002
30179870,1rtkit-daemon0-21swapper/223:07:522
3985024261,3sleep23987089-21tr00:35:182
3983848261,2sleep00-21swapper/000:35:160
3977009261,2sleep20-21swapper/200:30:122
3970985262,2sleep20-21swapper/200:25:162
3965487261,2sleep00-21swapper/000:20:160
3960489260,3sleep03962666-21kthreadcore00:15:160
3925328260,3sleep13925447-21latency_hist23:50:011
3916218261,2sleep03917919-21/usr/sbin/munin23:40:180
3882955260,4sleep03885124-21kthreadcore23:15:180
3879441260,3sleep13879580-21timerwakeupswit23:10:221
3861424261,3sleep03861616-21if_eno123:00:150
3861171260,3sleep13861204-21apt-get23:00:131
3854226260,1sleep10-21swapper/122:51:481
3848488260,3sleep03848613-21grep22:50:140
3837045260,4sleep13839104-21kthreadcore22:40:181
3836062261,2sleep00-21swapper/022:40:170
3810249261,3sleep13811418-21cat22:20:171
3791512260,3sleep03792945-21grep22:05:190
3788320261,2sleep10-21swapper/122:00:191
3778697262,2sleep10-21swapper/121:55:171
3757560260,1sleep00-21swapper/021:37:580
3731814261,2sleep10-21swapper/121:20:121
3720394261,2sleep00-21swapper/021:10:180
3712078260,1sleep00-21swapper/021:02:200
3686315260,3sleep03686333-21apt-get20:45:020
3654016260,1sleep00-21swapper/020:18:200
3647972261,2sleep13648005-21apt-get20:15:141
3641224260,1sleep00-21swapper/020:09:200
3596417260,3sleep13596499-21cut19:35:151
30179860,3rtkit-daemon638-21ntpd23:27:492
30179860,2rtkit-daemon3718969-21apt-get21:10:132
3963672250,1sleep20-21swapper/200:17:062
3956663250,3sleep20-21swapper/200:10:222
3945383251,2sleep20-21swapper/200:05:172
3944544250,1sleep00-21swapper/000:03:380
3925204250,1sleep00-21swapper/023:48:240
3911442251,2sleep00-21swapper/023:35:220
3905789250,1sleep00-21swapper/023:34:180
3888956251,2sleep20-21swapper/223:20:172
3886444250,1sleep10-21swapper/123:18:561
3876299251,2sleep00-21swapper/023:10:170
3869609251,2sleep10-21swapper/123:05:181
3835121250,1sleep00-21swapper/022:39:280
3822530250,2sleep03822730-21smartctl22:30:150
3802575250,3sleep10-21swapper/122:14:361
3776644250,1sleep00-21swapper/021:50:400
3770234250,3sleep00-21swapper/021:45:430
3739423250,2sleep10-21swapper/121:25:171
3738911251,2sleep00-21swapper/021:25:160
3731395250,1sleep10-21swapper/121:18:111
3724930250,1sleep10-21swapper/121:12:551
3718501250,1sleep00-21swapper/021:07:450
3718353250,1sleep10-21swapper/121:05:541
3706129251,1sleep10-21swapper/121:00:121
3705826250,3sleep00-21swapper/020:59:440
3699143250,1sleep00-21swapper/020:51:020
3673638250,2sleep10-21swapper/120:35:081
3673355250,1sleep00-21swapper/020:34:360
3667252250,2sleep13667285-21apt-get20:30:121
3666806250,1sleep00-21swapper/020:27:350
3655915250,3sleep13657919-21cut20:20:191
3655915250,3sleep13657919-21cut20:20:181
3647692250,1sleep00-21swapper/020:14:450
3635116250,2sleep13635149-21apt-get20:05:121
3628723251,2sleep03628725-21acpi20:00:090
3628444250,1sleep10-21swapper/119:59:591
3628340250,1sleep00-21swapper/019:58:380
3620999251,2sleep00-21swapper/019:50:210
3596109250,1sleep10-21swapper/119:34:511
3595794250,1sleep00-21swapper/019:30:450
3583007250,1sleep00-21swapper/019:21:030
3578633251,2sleep10-21swapper/119:20:161
3568665250,3sleep03570372-21df_inode19:15:030
3562108250,1sleep10-21swapper/119:10:031
3937852240,3sleep20-21swapper/223:55:512
3705848240,2sleep10-21swapper/121:00:011
3699112240,1sleep10-21swapper/120:50:391
3685968240,1sleep10-21swapper/120:40:341
3616734240,2sleep10-21swapper/119:50:181
3609448240,2sleep10-21swapper/119:45:121
3596381240,1sleep00-21swapper/019:35:130
3968810230,1sleep20-21swapper/200:20:192
3938667230,1sleep20-21swapper/200:00:162
3913149230,1sleep10-21swapper/123:40:161
3910596230,1sleep10-21swapper/123:35:181
3818777230,1sleep10-21swapper/122:25:191
3803048230,1sleep10-21swapper/122:15:141
3737308230,1sleep00-21swapper/021:20:230
3730847230,1sleep00-21swapper/021:15:220
3680123230,1sleep00-21swapper/020:40:050
3665728230,1sleep13666065-21strings20:25:191
3641789230,1sleep10-21swapper/120:10:171
3608163230,1sleep00-21swapper/019:40:230
3583571230,1sleep10-21swapper/119:25:131
3841842220,1sleep10-21swapper/122:45:021
3841842220,1sleep10-21swapper/122:45:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional