You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 04:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Tue Jun 02, 2026 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139099920,72rtkit-daemon0-21swapper/319:05:113
71201426439,19sleep10-21swapper/119:06:581
71211126343,14sleep20-21swapper/219:08:122
71077026343,14sleep00-21swapper/019:05:050
7280052580,3sleep10-21swapper/119:50:131
8123502530,7sleep342-21ksoftirqd/323:50:173
8131542490,4sleep13056-21PK-Backend23:54:251
7356372470,3sleep10-21swapper/120:10:181
7183982470,4sleep13056-21PK-Backend19:20:221
7218192440,3sleep20-21swapper/219:30:212
139099410,3rtkit-daemon0-21swapper/323:59:303
139099410,3rtkit-daemon0-21swapper/319:36:433
139099400,4rtkit-daemon3056-21PK-Backend23:22:493
139099390,3rtkit-daemon3056-21PK-Backend20:13:343
139099390,3rtkit-daemon0-21swapper/323:47:203
7627922300,13chrt13-21ksoftirqd/021:30:010
712487992923,4cyclictest34-21ksoftirqd/222:10:002
712487992715,4cyclictest141rcu_preempt21:03:252
712487992710,4cyclictest34-21ksoftirqd/222:35:002
712481992715,10cyclictest795907-21unin-run23:05:011
7931562260,4chrt3056-21PK-Backend22:55:192
7908912260,8sleep126-21ksoftirqd/122:50:131
7738202260,3chrt3056-21PK-Backend22:00:160
7526342260,4sleep33056-21PK-Backend21:00:123
712487992622,3cyclictest34-21ksoftirqd/200:15:002
712487992611,5cyclictest34-21ksoftirqd/221:13:112
71249099259,4cyclictest759192-21cron21:20:003
71248799259,4cyclictest34-21ksoftirqd/222:41:292
71248799259,4cyclictest34-21ksoftirqd/222:27:342
71248799257,4cyclictest34-21ksoftirqd/200:35:002
712487992514,4cyclictest34-21ksoftirqd/220:08:022
71247799256,5cyclictest13-21ksoftirqd/019:38:020
7258292240,4chrt3056-21PK-Backend19:45:012
71248799249,3cyclictest34-21ksoftirqd/223:11:172
71248799249,3cyclictest34-21ksoftirqd/220:55:352
71248799249,3cyclictest34-21ksoftirqd/220:18:582
712487992410,3cyclictest34-21ksoftirqd/223:06:232
712481992416,6cyclictest798239-21df23:10:141
712490992312,9cyclictest42-21ksoftirqd/320:05:203
71248799239,4cyclictest34-21ksoftirqd/220:43:522
712487992318,3cyclictest34-21ksoftirqd/221:25:002
712487992311,4cyclictest34-21ksoftirqd/223:22:032
712487992311,4cyclictest34-21ksoftirqd/220:48:492
712487992311,4cyclictest34-21ksoftirqd/200:17:052
712487992311,3cyclictest34-21ksoftirqd/220:29:492
712487992310,4cyclictest34-21ksoftirqd/222:38:122
712487992310,4cyclictest34-21ksoftirqd/222:24:332
712487992310,4cyclictest34-21ksoftirqd/220:54:192
712487992310,4cyclictest34-21ksoftirqd/220:20:222
712487992310,4cyclictest34-21ksoftirqd/219:53:082
71248199238,3cyclictest141rcu_preempt21:30:001
712481992320,2cyclictest3056-21PK-Backend00:30:071
8264912220,3sleep00-21swapper/000:30:210
7495942220,3chrt0-21swapper/020:50:180
71249099229,11cyclictest821927-21unin-run00:20:003
712490992220,1cyclictest0-21swapper/322:08:123
712490992220,1cyclictest0-21swapper/320:04:083
712490992218,2cyclictest42-21ksoftirqd/322:54:213
712490992214,6cyclictest739845-21cron20:25:003
71249099220,20cyclictest778018-21taskset22:11:573
71249099220,20cyclictest3056-21PK-Backend23:32:003
71248799229,4cyclictest34-21ksoftirqd/223:04:342
71248799229,4cyclictest34-21ksoftirqd/221:37:212
71248799229,4cyclictest34-21ksoftirqd/220:38:422
71248799228,3cyclictest34-21ksoftirqd/219:20:562
71248799226,4cyclictest34-21ksoftirqd/221:09:222
712487992220,1cyclictest0-21swapper/223:35:482
712487992220,1cyclictest0-21swapper/222:51:132
712487992220,1cyclictest0-21swapper/220:11:272
712487992220,1cyclictest0-21swapper/220:00:112
712487992217,4cyclictest34-21ksoftirqd/200:00:012
712487992214,6cyclictest774081-21ntp_states22:00:182
712487992210,4cyclictest34-21ksoftirqd/221:42:352
712487992210,4cyclictest34-21ksoftirqd/221:34:482
712487992210,4cyclictest34-21ksoftirqd/220:32:212
712487992210,3cyclictest34-21ksoftirqd/222:19:402
71248799220,2cyclictest141rcu_preempt19:50:002
712481992220,1cyclictest0-21swapper/121:06:071
712481992220,1cyclictest0-21swapper/120:27:411
712481992215,5cyclictest764431-21systemctl21:35:001
71247799227,5cyclictest13-21ksoftirqd/022:13:520
712477992211,7cyclictest883-21dbus-daemon20:50:010
71247799220,2cyclictest1788620-21WebKitWebProces20:23:220
139099220,16rtkit-daemon3056-21PK-Backend22:58:413
139099220,16rtkit-daemon3056-21PK-Backend22:47:073
139099220,15rtkit-daemon3056-21PK-Backend19:58:273
139099220,14rtkit-daemon0-21swapper/323:40:163
71249099218,11cyclictest436-20systemd-journal19:15:023
712490992119,1cyclictest3056-21PK-Backend22:30:093
712490992119,1cyclictest3056-21PK-Backend20:57:003
712490992119,1cyclictest3056-21PK-Backend19:49:213
712490992119,1cyclictest0-21swapper/323:36:403
712490992119,1cyclictest0-21swapper/322:00:423
712490992119,1cyclictest0-21swapper/300:24:383
712490992113,6cyclictest436-20systemd-journal21:54:593
71249099211,18cyclictest719928-21python319:25:203
71249099211,18cyclictest719928-21python319:25:193
71249099210,19cyclictest3056-21PK-Backend23:25:313
71249099210,19cyclictest3056-21PK-Backend21:36:083
71249099210,19cyclictest3056-21PK-Backend20:17:193
71248799218,3cyclictest34-21ksoftirqd/200:20:082
71248799218,2cyclictest141rcu_preempt19:35:132
71248799217,3cyclictest141rcu_preempt23:30:172
712487992119,1cyclictest0-21swapper/221:51:112
712481992119,1cyclictest3056-21PK-Backend22:16:101
712481992119,1cyclictest0-21swapper/122:46:391
712481992119,1cyclictest0-21swapper/122:31:581
712481992119,1cyclictest0-21swapper/122:27:251
712481992119,1cyclictest0-21swapper/120:31:121
71248199210,20cyclictest3056-21PK-Backend19:37:111
71248199210,20cyclictest0-21swapper/123:55:061
71248199210,20cyclictest0-21swapper/122:38:071
71248199210,20cyclictest0-21swapper/120:00:511
71247799217,5cyclictest13-21ksoftirqd/019:15:520
712477992117,3cyclictest13-21ksoftirqd/021:14:100
71247799211,5cyclictest758599-21python321:15:240
712477992114,6cyclictest883-21dbus-daemon23:19:120
71247799211,14cyclictest978-21snmpd20:40:230
71247799210,2cyclictest733193-21apt20:05:110
71247799210,1cyclictest3056-21PK-Backend21:25:000
712490992018,1cyclictest3056-21PK-Backend22:29:203
712490992018,1cyclictest3056-21PK-Backend21:43:113
712490992018,1cyclictest3056-21PK-Backend21:13:443
712490992018,1cyclictest3056-21PK-Backend21:08:093
712490992018,1cyclictest3056-21PK-Backend20:50:183
712490992018,1cyclictest0-21swapper/321:32:363
712490992018,1cyclictest0-21swapper/319:12:243
712490992017,2cyclictest3056-21PK-Backend22:21:503
712490992016,2cyclictest0-21swapper/300:05:133
712490992014,5cyclictest795878-21sh23:05:013
71249099200,6cyclictest726071-21latency_hist19:45:013
71249099200,1cyclictest3056-21PK-Backend22:40:503
71249099200,1cyclictest3056-21PK-Backend21:45:203
71249099200,1cyclictest3056-21PK-Backend20:40:593
71249099200,19cyclictest0-21swapper/319:53:543
71249099200,19cyclictest0-21swapper/319:22:103
71249099200,19cyclictest0-21swapper/300:04:113
71249099200,18cyclictest3056-21PK-Backend23:09:573
71248799209,4cyclictest34-21ksoftirqd/219:10:092
71248799206,4cyclictest34-21ksoftirqd/200:35:132
712487992018,1cyclictest0-21swapper/223:45:072
712487992018,1cyclictest0-21swapper/223:40:282
712487992018,1cyclictest0-21swapper/221:58:272
712487992018,1cyclictest0-21swapper/221:15:212
71248799200,1cyclictest0-21swapper/219:15:442
71248799200,19cyclictest0-21swapper/221:48:132
71248799200,10cyclictest34-21ksoftirqd/222:45:222
712481992018,1cyclictest3056-21PK-Backend21:53:051
712481992018,1cyclictest3056-21PK-Backend19:31:511
712481992018,1cyclictest0-21swapper/121:01:071
712481992018,1cyclictest0-21swapper/119:41:101
712481992015,4cyclictest26-21ksoftirqd/120:20:121
712481992012,6cyclictest803803-21ntpq23:25:191
71248199200,1cyclictest3056-21PK-Backend23:19:101
71248199200,19cyclictest3056-21PK-Backend22:07:511
71248199200,19cyclictest3056-21PK-Backend00:23:111
71248199200,19cyclictest3056-21PK-Backend00:01:211
71248199200,19cyclictest0-21swapper/123:06:111
71248199200,19cyclictest0-21swapper/121:14:101
71248199200,19cyclictest0-21swapper/120:50:321
71248199200,19cyclictest0-21swapper/119:56:591
71247799207,4cyclictest13-21ksoftirqd/020:04:040
71247799206,3cyclictest141rcu_preempt22:00:010
712477992018,1cyclictest0-21swapper/022:38:210
712477992013,6cyclictest769599-21cron21:50:000
712477992013,5cyclictest793905-21munin-run23:00:010
712477992012,6cyclictest744332-21ntp_states20:35:200
712477992012,2cyclictest13-21ksoftirqd/000:00:010
712477992011,7cyclictest820160-21cron00:15:000
71247799200,19cyclictest3056-21PK-Backend19:41:110
71247799200,19cyclictest0-21swapper/022:28:410
71247799200,19cyclictest0-21swapper/020:57:090
71247799200,19cyclictest0-21swapper/020:16:120
71247799200,19cyclictest0-21swapper/000:36:100
139099200,14rtkit-daemon3056-21PK-Backend22:35:343
139099200,14rtkit-daemon0-21swapper/200:26:092
139099200,14rtkit-daemon0-21swapper/200:01:092
712490991912,5cyclictest773304-21cut22:00:013
71249099191,16cyclictest827102-21munin-plugin-st00:35:003
712490991910,7cyclictest740490-21df_inode20:25:103
71249099190,1cyclictest3056-21PK-Backend20:33:083
71249099190,1cyclictest0-21swapper/323:18:213
71249099190,18cyclictest3056-21PK-Backend00:11:283
71249099190,18cyclictest0-21swapper/321:25:333
71249099190,18cyclictest0-21swapper/319:31:503
71248799191,7cyclictest0-21swapper/219:25:192
71248799191,7cyclictest0-21swapper/219:25:192
712487991911,5cyclictest34-21ksoftirqd/200:05:202
71248799190,18cyclictest0-21swapper/221:25:152
712481991917,1cyclictest3056-21PK-Backend19:14:401
712481991917,1cyclictest0-21swapper/122:23:401
712481991916,2cyclictest768492-21cstates21:45:141
712481991916,2cyclictest3056-21PK-Backend23:47:491
712481991916,2cyclictest0-21swapper/122:40:291
712481991914,3cyclictest748540-21latency_hist20:49:591
712481991913,5cyclictest26-21ksoftirqd/100:14:591
712481991912,6cyclictest744549-21ls20:35:221
712481991911,6cyclictest765535-21python321:35:211
71248199190,1cyclictest3056-21PK-Backend19:28:061
71248199190,1cyclictest3056-21PK-Backend19:28:061
71248199190,1cyclictest3056-21PK-Backend00:37:501
71248199190,1cyclictest0-21swapper/123:32:151
71248199190,1cyclictest0-21swapper/120:56:411
71248199190,1cyclictest0-21swapper/119:18:041
71248199190,18cyclictest3056-21PK-Backend23:42:071
71248199190,18cyclictest3056-21PK-Backend21:23:171
71247799196,4cyclictest13-21ksoftirqd/023:54:130
71247799196,4cyclictest13-21ksoftirqd/022:52:540
71247799196,4cyclictest13-21ksoftirqd/022:17:040
71247799196,4cyclictest13-21ksoftirqd/019:32:370
71247799192,3cyclictest141rcu_preempt00:26:570
71247799192,12cyclictest820432-21apt00:15:120
712477991917,1cyclictest0-21swapper/000:23:250
712477991913,5cyclictest1389-21rtkit-daemon23:44:130
712477991912,5cyclictest2156-21gnome-shell00:04:090
71247799190,1cyclictest0-21swapper/022:45:500
71247799190,1cyclictest0-21swapper/020:10:240
71247799190,1cyclictest0-21swapper/019:11:440
71247799190,18cyclictest0-21swapper/023:32:220
71247799190,18cyclictest0-21swapper/023:22:560
71247799190,18cyclictest0-21swapper/022:20:500
71247799190,18cyclictest0-21swapper/021:10:000
71247799190,18cyclictest0-21swapper/020:29:230
71247799190,18cyclictest0-21swapper/019:27:390
71247799190,18cyclictest0-21swapper/019:27:380
71247799190,18cyclictest0-21swapper/019:23:330
139099190,13rtkit-daemon0-21swapper/219:57:232
712490991813,3cyclictest828845-21latency_hist00:40:003
71248799183,10cyclictest811755-21apt23:50:132
712487991816,1cyclictest0-21swapper/222:10:442
712487991811,5cyclictest803546-21cat23:25:152
712481991816,1cyclictest3056-21PK-Backend23:35:041
712481991816,1cyclictest3056-21PK-Backend22:12:251
712481991816,1cyclictest3056-21PK-Backend22:01:571
712481991816,1cyclictest0-21swapper/120:07:261
712481991816,1cyclictest0-21swapper/100:16:291
712481991813,3cyclictest793176-21open_inodes22:55:201
712481991810,6cyclictest767853-21cron21:44:591
712481991810,6cyclictest758602-21python321:15:241
712481991810,6cyclictest726266-21apt19:45:131
71247799185,5cyclictest13-21ksoftirqd/023:35:570
71247799185,4cyclictest13-21ksoftirqd/023:49:110
71247799185,4cyclictest13-21ksoftirqd/021:50:100
71247799184,5cyclictest13-21ksoftirqd/000:06:160
71247799183,3cyclictest141rcu_preempt22:07:470
71247799182,11cyclictest803088-21apt23:25:120
712477991816,1cyclictest0-21swapper/022:42:540
712477991816,1cyclictest0-21swapper/020:30:120
712477991816,1cyclictest0-21swapper/019:57:390
712477991814,3cyclictest796353-21cstates23:05:140
712477991813,3cyclictest1095-21runrttasks19:45:150
712477991811,5cyclictest795491-21sshd23:00:260
712477991811,5cyclictest728441-21cat19:50:170
712477991811,4cyclictest0-21swapper/021:00:050
71249099170,15cyclictest760965-21munin-run21:24:593
71248799176,2cyclictest141rcu_preempt23:15:162
712481991715,1cyclictest3056-21PK-Backend21:58:121
712481991715,1cyclictest0-21swapper/120:16:451
712481991712,3cyclictest802385-21timerwakeupswit23:20:211
71248199171,12cyclictest745332-21apt20:40:141
71247799174,4cyclictest13-21ksoftirqd/021:30:020
712477991715,1cyclictest0-21swapper/023:10:390
712477991715,1cyclictest0-21swapper/022:30:170
712477991713,3cyclictest765529-21sensors_temp21:35:210
71249099165,10cyclictest42-21ksoftirqd/300:25:123
712490991611,3cyclictest778516-21/usr/sbin/munin22:15:153
712490991611,3cyclictest745067-21idleruntime-cro20:40:003
712481991614,1cyclictest3056-21PK-Backend00:07:351
71248199160,6cyclictest3056-21PK-Backend00:25:211
712477991610,3cyclictest0-21swapper/021:40:210
71249099140,2cyclictest141rcu_preempt20:45:233
71249099130,2cyclictest141rcu_preempt23:10:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional