You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 16:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Fri Aug 21, 2026 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14195321370,2sleep00-21swapper/010:10:150
9496921280,2sleep33056-21PK-Backend07:55:213
7628821130,8sleep00-21swapper/007:05:120
139099790,62rtkit-daemon0-21swapper/107:05:161
7620727544,21sleep20-21swapper/207:05:122
7742326141,14sleep30-21swapper/307:06:453
1368892490,3sleep03056-21PK-Backend09:55:160
1699112480,4sleep30-21swapper/311:30:153
1312062440,2sleep30-21swapper/309:40:143
1837312420,1sleep30-21swapper/312:10:123
1559732370,3sleep30-21swapper/310:50:163
77835992711,14cyclictest42-21ksoftirqd/308:55:183
139099270,20rtkit-daemon3056-21PK-Backend11:32:581
77835992516,6cyclictest153379-21cron10:45:003
7783599240,5cyclictest84393-21needreboot07:25:173
7783599240,22cyclictest87685-21cut07:35:173
77831992416,6cyclictest187523-21fw_packets12:20:142
139099240,16rtkit-daemon3056-21PK-Backend10:41:211
77835992321,1cyclictest0-21swapper/312:18:263
77835992320,2cyclictest0-21swapper/308:49:053
7782699230,3cyclictest157131-21/usr/sbin/munin10:55:121
7782699230,3cyclictest104965-21diskstats08:25:121
77835992220,1cyclictest0-21swapper/311:42:163
77835992220,1cyclictest0-21swapper/311:08:583
77835992220,1cyclictest0-21swapper/309:38:533
7783599220,20cyclictest3056-21PK-Backend10:00:513
7783599220,20cyclictest3056-21PK-Backend09:11:023
77831992220,1cyclictest0-21swapper/210:52:452
77831992220,1cyclictest0-21swapper/210:02:162
77831992219,2cyclictest0-21swapper/210:40:362
77831992219,2cyclictest0-21swapper/208:36:452
77831992215,5cyclictest1-21systemd11:40:002
7782699220,21cyclictest0-21swapper/108:02:211
7782699220,20cyclictest3056-21PK-Backend08:55:411
7782699220,20cyclictest138609-21sed10:00:161
77822992220,1cyclictest0-21swapper/007:11:540
7782299220,21cyclictest937522sleep007:53:190
1455372220,4chrt3056-21PK-Backend10:20:163
1447632220,4chrt3056-21PK-Backend10:20:003
139099220,15rtkit-daemon3056-21PK-Backend08:55:010
139099220,14rtkit-daemon0-21swapper/011:31:400
985212210,3chrt0-21swapper/008:05:200
985212210,3chrt0-21swapper/008:05:200
77835992119,1cyclictest0-21swapper/312:05:563
77835992119,1cyclictest0-21swapper/311:56:363
77835992119,1cyclictest0-21swapper/308:54:273
77835992119,1cyclictest0-21swapper/307:45:583
77835992119,1cyclictest0-21swapper/307:31:043
77835992119,1cyclictest0-21swapper/307:23:413
77835992118,2cyclictest3056-21PK-Backend09:16:093
77835992118,2cyclictest3056-21PK-Backend08:16:553
7783599210,8cyclictest99370-21/usr/sbin/munin08:10:103
7783599210,20cyclictest0-21swapper/311:22:433
77831992119,1cyclictest3056-21PK-Backend12:25:462
77831992119,1cyclictest0-21swapper/211:56:462
77831992119,1cyclictest0-21swapper/209:31:212
77831992119,1cyclictest0-21swapper/209:13:422
77831992119,1cyclictest0-21swapper/208:56:392
77831992119,1cyclictest0-21swapper/208:46:592
77831992119,1cyclictest0-21swapper/207:30:352
77831992119,1cyclictest0-21swapper/207:22:232
77831992114,5cyclictest160332-21/usr/sbin/munin11:05:002
7783199210,20cyclictest0-21swapper/212:06:542
7783199210,20cyclictest0-21swapper/211:54:232
7783199210,20cyclictest0-21swapper/211:15:312
7783199210,20cyclictest0-21swapper/208:23:332
7783199210,19cyclictest0-21swapper/208:06:512
7783199210,19cyclictest0-21swapper/208:06:502
7783199210,19cyclictest0-21swapper/208:01:172
7783199210,19cyclictest0-21swapper/207:56:022
77826992112,7cyclictest93511-21users07:50:211
77822992119,1cyclictest0-21swapper/009:01:520
77822992113,7cyclictest1-21systemd12:15:000
77822992111,8cyclictest883-21dbus-daemon07:57:550
7782299210,20cyclictest0-21swapper/010:22:090
7782299210,20cyclictest0-21swapper/009:08:070
139099210,15rtkit-daemon3056-21PK-Backend11:16:410
139099210,15rtkit-daemon3056-21PK-Backend09:20:461
139099210,15rtkit-daemon0-21swapper/007:21:270
139099210,14rtkit-daemon0-21swapper/011:37:460
1070222210,8sleep342-21ksoftirqd/308:30:173
77835992018,1cyclictest3056-21PK-Backend08:23:583
77835992018,1cyclictest3056-21PK-Backend07:11:383
77835992018,1cyclictest0-21swapper/312:20:493
77835992017,2cyclictest3056-21PK-Backend08:06:193
77835992017,2cyclictest3056-21PK-Backend08:06:193
7783599200,19cyclictest3056-21PK-Backend12:31:443
7783599200,19cyclictest3056-21PK-Backend09:30:223
7783599200,19cyclictest3056-21PK-Backend08:27:023
7783599200,19cyclictest0-21swapper/312:39:293
7783599200,19cyclictest0-21swapper/311:54:133
77831992018,1cyclictest0-21swapper/210:19:472
77831992018,1cyclictest0-21swapper/209:52:152
77831992018,1cyclictest0-21swapper/208:25:302
77831992018,1cyclictest0-21swapper/207:19:592
77831992017,2cyclictest3056-21PK-Backend12:30:332
77831992013,5cyclictest34-21ksoftirqd/210:45:112
77831992013,5cyclictest1-21systemd10:15:012
7783199200,19cyclictest0-21swapper/212:04:302
7783199200,19cyclictest0-21swapper/210:30:482
7783199200,19cyclictest0-21swapper/209:17:272
7783199200,19cyclictest0-21swapper/209:07:492
7783199200,19cyclictest0-21swapper/207:37:242
77826992017,2cyclictest3056-21PK-Backend07:34:501
77826992012,6cyclictest82510-21sed07:20:161
7782699200,1cyclictest3056-21PK-Backend12:13:401
7782699200,1cyclictest3056-21PK-Backend11:57:381
7782699200,1cyclictest3056-21PK-Backend11:02:221
7782699200,1cyclictest3056-21PK-Backend09:00:201
7782699200,1cyclictest0-21swapper/107:25:031
7782699200,19cyclictest3056-21PK-Backend12:03:461
7782699200,19cyclictest3056-21PK-Backend10:48:501
7782699200,18cyclictest3056-21PK-Backend11:05:331
77822992018,1cyclictest3056-21PK-Backend10:30:080
77822992018,1cyclictest0-21swapper/011:25:500
77822992018,1cyclictest0-21swapper/011:11:300
77822992018,1cyclictest0-21swapper/010:50:480
77822992018,1cyclictest0-21swapper/010:40:280
77822992016,3cyclictest0-21swapper/009:54:040
7782299200,1cyclictest0-21swapper/010:15:470
7782299200,19cyclictest3056-21PK-Backend10:25:200
7782299200,19cyclictest0-21swapper/012:35:530
7782299200,19cyclictest0-21swapper/012:33:310
7782299200,19cyclictest0-21swapper/012:07:200
7782299200,19cyclictest0-21swapper/011:40:100
7782299200,19cyclictest0-21swapper/010:04:380
7782299200,19cyclictest0-21swapper/008:50:440
7782299200,19cyclictest0-21swapper/008:31:300
7782299200,19cyclictest0-21swapper/008:13:530
7782299200,19cyclictest0-21swapper/007:37:090
7782299200,19cyclictest0-21swapper/007:32:090
139099200,14rtkit-daemon3056-21PK-Backend08:47:131
139099200,14rtkit-daemon0-21swapper/111:16:271
1016482200,5sleep20-21swapper/208:15:162
77835991917,1cyclictest3056-21PK-Backend09:51:033
77835991917,1cyclictest0-21swapper/310:35:193
77835991913,4cyclictest164467-21idleruntime11:15:143
77835991911,6cyclictest154034-21diskstats10:45:133
7783599190,1cyclictest3056-21PK-Backend09:28:473
7783599190,1cyclictest3056-21PK-Backend08:41:003
7783599190,1cyclictest3056-21PK-Backend08:00:123
7783599190,1cyclictest0-21swapper/312:02:453
7783599190,16cyclictest124400-21irqstats09:20:173
7783199194,5cyclictest79491-21ls07:15:002
77831991917,1cyclictest0-21swapper/211:44:512
77831991917,1cyclictest0-21swapper/210:08:512
77831991917,1cyclictest0-21swapper/209:40:052
77831991917,1cyclictest0-21swapper/209:28:572
77831991917,1cyclictest0-21swapper/209:22:482
77831991917,1cyclictest0-21swapper/208:43:142
77831991917,1cyclictest0-21swapper/207:52:102
77831991917,1cyclictest0-21swapper/207:46:292
77831991913,4cyclictest174723-21cat11:45:122
77831991911,7cyclictest136888-21/usr/sbin/munin09:55:152
7783199190,18cyclictest3056-21PK-Backend07:41:492
77826991917,1cyclictest3056-21PK-Backend07:40:041
77826991917,1cyclictest0-21swapper/112:28:201
77826991917,1cyclictest0-21swapper/109:15:141
77826991917,1cyclictest0-21swapper/109:06:371
77826991917,1cyclictest0-21swapper/108:34:521
77826991917,1cyclictest0-21swapper/107:59:171
77826991916,2cyclictest3056-21PK-Backend09:59:281
77826991914,3cyclictest2156-21gnome-shell09:30:091
77826991912,6cyclictest81718-21/usr/sbin/munin07:20:011
77826991912,5cyclictest26-21ksoftirqd/108:05:191
77826991912,5cyclictest26-21ksoftirqd/108:05:181
77826991912,5cyclictest145348-21expr10:20:131
77826991912,5cyclictest111267-21sshd08:41:561
77826991911,6cyclictest103759-21sed08:20:191
7782699190,2cyclictest3056-21PK-Backend12:20:371
7782699190,1cyclictest0-21swapper/110:52:021
7782699190,18cyclictest3056-21PK-Backend11:53:061
7782699190,18cyclictest0-21swapper/109:14:281
7782699190,18cyclictest0-21swapper/107:45:181
7782699190,18cyclictest0-21swapper/107:11:241
77822991917,1cyclictest3056-21PK-Backend10:45:140
77822991917,1cyclictest0-21swapper/012:18:020
77822991917,1cyclictest0-21swapper/011:56:400
77822991917,1cyclictest0-21swapper/010:56:240
77822991917,1cyclictest0-21swapper/010:36:290
77822991917,1cyclictest0-21swapper/007:46:020
77822991916,2cyclictest3056-21PK-Backend11:00:230
77822991914,3cyclictest189771-21missed_timers12:25:150
77822991912,5cyclictest79923-21cat07:15:010
7782299190,1cyclictest0-21swapper/012:24:580
7782299190,1cyclictest0-21swapper/010:07:490
7782299190,1cyclictest0-21swapper/009:30:250
7782299190,1cyclictest0-21swapper/008:43:130
7782299190,18cyclictest0-21swapper/009:40:320
7782299190,18cyclictest0-21swapper/008:46:110
7782299190,18cyclictest0-21swapper/007:42:230
139099190,13rtkit-daemon0-21swapper/011:08:430
77835991816,1cyclictest3056-21PK-Backend07:53:283
7783599181,3cyclictest149041-21memory10:30:173
77835991812,4cyclictest89819-21rt-features07:40:193
7783599180,3cyclictest162697-21diskstats11:10:143
7783599180,16cyclictest159435-21memory11:00:153
77831991816,1cyclictest0-21swapper/212:10:062
77831991811,5cyclictest99661-21expr08:10:122
77831991811,5cyclictest186674-21apt-key12:20:002
77826991816,1cyclictest3056-21PK-Backend11:12:421
77826991814,2cyclictest146728-21apt10:25:111
77826991812,4cyclictest129702-21missed_timers09:35:161
77826991811,5cyclictest913-21gdbus08:15:011
77826991811,5cyclictest193033-21df12:35:111
77822991816,1cyclictest0-21swapper/011:21:030
77822991816,1cyclictest0-21swapper/009:26:390
77822991816,1cyclictest0-21swapper/009:16:130
77822991811,5cyclictest105610-21sed08:25:200
77822991810,6cyclictest104335-21ls08:25:010
7782299180,17cyclictest3056-21PK-Backend09:37:210
7783599179,6cyclictest132976-21forks09:45:143
7783599171,3cyclictest168384-21python311:25:213
77835991713,3cyclictest0-21swapper/311:35:213
77835991712,3cyclictest189385-21cstates12:25:103
7783599171,14cyclictest136686-21diskstats09:55:123
7783599170,15cyclictest175096-21df_inode11:45:143
77831991715,1cyclictest0-21swapper/212:35:192
77831991713,3cyclictest146472-21turbostat.cron10:25:002
77831991711,4cyclictest169207-21sed11:30:012
77831991710,5cyclictest133121-21sed09:45:162
7782699179,6cyclictest192067-21sshd12:30:551
77826991715,1cyclictest3056-21PK-Backend12:16:031
77826991715,1cyclictest3056-21PK-Backend12:05:211
77826991711,5cyclictest148903-21awk10:30:151
77826991711,5cyclictest144756-21systemctl10:20:001
7782299179,6cyclictest109066-21ntp_states08:35:190
77822991715,1cyclictest0-21swapper/009:22:550
77822991710,5cyclictest96215-21expr08:00:120
7783599169,5cyclictest42-21ksoftirqd/310:05:143
77835991614,1cyclictest3056-21PK-Backend09:07:303
7783599160,2cyclictest147588-21python310:25:193
7783199169,5cyclictest167484-21date11:25:012
7783199167,7cyclictest84083-21df_inode07:25:122
77831991614,1cyclictest0-21swapper/210:25:142
77831991612,3cyclictest978-21snmpd09:01:122
77831991611,4cyclictest115098-21sed08:55:012
77831991611,3cyclictest162688-21sh11:10:142
77831991611,3cyclictest129879-21open_files09:35:192
77831991610,5cyclictest169730-21ls11:30:112
7782699169,5cyclictest141861-21cat10:10:121
7782699169,5cyclictest114439-21grep08:50:221
7782699168,6cyclictest140363-21memory10:05:171
77826991611,3cyclictest136021-21apt-config09:55:021
77826991611,3cyclictest127127-21latency_hist09:30:001
77826991610,4cyclictest102736-21date08:20:001
7782299169,6cyclictest133035-21cat09:45:150
77822991612,3cyclictest176940-21irqstats11:50:170
77835991513,1cyclictest3056-21PK-Backend08:35:333
77835991511,3cyclictest116965-21/usr/sbin/munin09:00:183
7783199158,5cyclictest160655-21cat11:05:102
7783199157,6cyclictest150397-21cat10:35:122
77831991511,3cyclictest106500-21tr08:30:132
7782699159,4cyclictest171425-21cut11:35:111
7782699158,5cyclictest87322-21grep07:35:131
7782699158,5cyclictest131607-21ntpq09:40:221
7782699158,5cyclictest109033-21ntp_kernel_err08:35:191
77826991510,3cyclictest174459-21dump-pmu-power11:45:001
7782299158,5cyclictest121192-21ntpq09:10:170
77822991513,1cyclictest0-21swapper/012:02:480
77822991511,3cyclictest85171-21cron07:30:010
77835991412,1cyclictest3056-21PK-Backend07:17:323
77835991411,2cyclictest3056-21PK-Backend10:55:163
77835991411,2cyclictest3056-21PK-Backend10:10:463
77831991410,3cyclictest158590-21idleruntime-cro10:59:592
77826991411,2cyclictest3056-21PK-Backend11:20:411
77826991410,3cyclictest3056-21PK-Backend11:28:031
77822991412,1cyclictest0-21swapper/008:19:480
7782299136,5cyclictest175156-21cat11:45:160
7782699127,4cyclictest3056-21PK-Backend09:47:271
77826991210,1cyclictest3056-21PK-Backend11:45:211
7782699118,2cyclictest1513392chrt10:36:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional