You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 06:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Thu Jul 09, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
81316621170,3sleep10-21swapper/100:30:231
74678721070,4sleep1746782-21cron21:25:001
70912921070,4sleep00-21swapper/019:35:150
69792121000,4sleep20-21swapper/219:05:182
139099770,62rtkit-daemon0-21swapper/319:05:223
69831227642,27sleep10-21swapper/119:05:261
69866726241,13sleep00-21swapper/019:07:090
7888312590,2sleep00-21swapper/023:25:010
7001092430,3sleep00-21swapper/019:10:210
7025412400,3sleep13056-21PK-Backend19:15:241
69904599319,21cyclictest795911-21cron23:45:001
69904599319,21cyclictest795911-21cron23:45:001
139099300,2rtkit-daemon0-21swapper/021:13:590
699045992717,7cyclictest806589-21cron00:15:001
699045992716,7cyclictest436-20systemd-journal23:35:001
139099260,4rtkit-daemon1389-21rtkit-daemon22:55:021
139099260,4rtkit-daemon1389-21rtkit-daemon21:53:031
699051992516,8cyclictest699964-21ntpq19:10:183
69904799250,23cyclictest1788620-21WebKitWebProces23:44:082
69904799250,23cyclictest1788620-21WebKitWebProces23:44:072
7150732240,3sleep33056-21PK-Backend19:55:003
7150732240,3sleep33056-21PK-Backend19:55:003
69905199245,7cyclictest42-21ksoftirqd/320:28:013
69905199245,7cyclictest42-21ksoftirqd/319:40:433
69905199244,7cyclictest42-21ksoftirqd/323:55:233
699051992421,2cyclictest411rcuc/319:37:203
699051992421,2cyclictest411rcuc/319:18:213
699047992414,8cyclictest789416-21basename23:25:122
7236922230,9sleep013-21ksoftirqd/020:19:550
69905199235,7cyclictest42-21ksoftirqd/319:47:413
699051992320,2cyclictest411rcuc/320:19:443
699051992319,3cyclictest411rcuc/323:50:183
699045992315,6cyclictest762662-21/usr/sbin/munin22:10:001
699045992314,6cyclictest730415-21sshd20:37:151
69904599230,9cyclictest7638952sed22:10:211
699041992315,6cyclictest883-21dbus-daemon00:28:030
69904199230,22cyclictest1389-21rtkit-daemon22:19:080
139099230,15rtkit-daemon0-21swapper/200:20:202
7337252220,4sleep13056-21PK-Backend20:45:221
7337252220,4sleep13056-21PK-Backend20:45:221
7325962220,2sleep30-21swapper/320:45:013
69905199228,5cyclictest42-21ksoftirqd/319:35:013
69905199222,7cyclictest42-21ksoftirqd/319:26:123
699051992220,1cyclictest3056-21PK-Backend23:35:003
699051992220,1cyclictest3056-21PK-Backend22:45:313
699051992220,1cyclictest3056-21PK-Backend22:45:313
699051992220,1cyclictest3056-21PK-Backend22:08:343
699051992219,2cyclictest411rcuc/323:20:083
699051992219,2cyclictest411rcuc/322:15:073
699051992215,5cyclictest797658-21ls23:50:003
69905199220,21cyclictest3056-21PK-Backend22:40:323
699047992220,1cyclictest0-21swapper/223:07:442
699047992220,1cyclictest0-21swapper/221:40:102
69904799220,21cyclictest0-21swapper/223:01:292
69904799220,20cyclictest0-21swapper/220:50:092
699045992220,1cyclictest3056-21PK-Backend20:18:151
699045992215,5cyclictest728907-21sh20:35:011
699045992210,10cyclictest774816-21unin-run22:44:591
69904599220,21cyclictest0-21swapper/121:15:131
699041992214,6cyclictest705277-21df19:25:120
69904199220,21cyclictest0-21swapper/023:41:080
69904199220,21cyclictest0-21swapper/023:41:070
139099220,3rtkit-daemon1389-21rtkit-daemon19:41:311
69905199214,6cyclictest42-21ksoftirqd/321:08:163
69905199214,5cyclictest42-21ksoftirqd/322:35:013
699051992119,1cyclictest3056-21PK-Backend23:42:093
699051992119,1cyclictest3056-21PK-Backend23:42:093
699051992119,1cyclictest3056-21PK-Backend22:12:473
699051992119,1cyclictest3056-21PK-Backend22:04:223
699051992119,1cyclictest3056-21PK-Backend21:16:163
699051992119,1cyclictest3056-21PK-Backend20:00:103
699051992119,1cyclictest0-21swapper/320:14:113
699051992119,1cyclictest0-21swapper/319:55:253
699051992119,1cyclictest0-21swapper/319:21:113
699051992118,2cyclictest411rcuc/322:39:543
699051992117,2cyclictest411rcuc/320:50:593
69905199210,20cyclictest3056-21PK-Backend21:46:043
69905199210,20cyclictest3056-21PK-Backend20:56:483
69905199210,20cyclictest3056-21PK-Backend00:38:543
69905199210,20cyclictest3056-21PK-Backend00:33:053
69904799213,16cyclictest792186-21cron23:35:012
699047992119,1cyclictest0-21swapper/223:57:062
699047992119,1cyclictest0-21swapper/222:43:042
699047992119,1cyclictest0-21swapper/222:35:332
699047992119,1cyclictest0-21swapper/222:13:302
699047992119,1cyclictest0-21swapper/222:00:042
699047992119,1cyclictest0-21swapper/221:27:202
699047992119,1cyclictest0-21swapper/221:17:472
699047992119,1cyclictest0-21swapper/221:00:092
699047992119,1cyclictest0-21swapper/220:42:102
699047992119,1cyclictest0-21swapper/220:16:022
699047992119,1cyclictest0-21swapper/220:13:382
699047992119,1cyclictest0-21swapper/219:32:012
699047992119,1cyclictest0-21swapper/219:13:432
699047992119,1cyclictest0-21swapper/200:17:332
699047992119,1cyclictest0-21swapper/200:02:402
699047992113,6cyclictest883-21dbus-daemon20:58:032
69904799210,20cyclictest0-21swapper/223:18:382
69904799210,20cyclictest0-21swapper/222:25:462
69904799210,20cyclictest0-21swapper/221:57:012
69904799210,20cyclictest0-21swapper/221:09:002
69904799210,20cyclictest0-21swapper/220:21:222
69904799210,20cyclictest0-21swapper/219:19:572
69904799210,19cyclictest0-21swapper/222:57:572
69904599212,14cyclictest806868-21apt00:15:081
699045992119,1cyclictest0-21swapper/122:48:571
699045992119,1cyclictest0-21swapper/122:48:571
699045992118,2cyclictest0-21swapper/123:25:121
699045992115,4cyclictest720665-21grep20:10:121
699045992114,5cyclictest1-21systemd22:25:011
699045992111,7cyclictest1-21systemd20:58:031
699041992119,1cyclictest0-21swapper/020:23:570
699041992119,1cyclictest0-21swapper/019:32:470
699041992114,5cyclictest813245-21sshd00:31:150
699041992113,6cyclictest436-20systemd-journal21:04:590
69904199210,20cyclictest3056-21PK-Backend23:51:290
69904199210,20cyclictest0-21swapper/023:17:420
139099210,15rtkit-daemon3056-21PK-Backend00:05:473
69905199204,5cyclictest42-21ksoftirqd/321:35:173
69905199202,6cyclictest42-21ksoftirqd/322:24:393
699051992018,1cyclictest3056-21PK-Backend22:29:363
69905199200,8cyclictest3056-21PK-Backend20:32:483
69905199200,6cyclictest3056-21PK-Backend00:13:353
69905199200,1cyclictest3056-21PK-Backend00:25:283
69905199200,1cyclictest3056-21PK-Backend00:19:073
69905199200,19cyclictest3056-21PK-Backend23:36:343
69905199200,19cyclictest3056-21PK-Backend23:29:263
69905199200,19cyclictest3056-21PK-Backend21:54:143
69905199200,19cyclictest3056-21PK-Backend20:09:573
69905199200,19cyclictest0-21swapper/320:48:523
69905199200,19cyclictest0-21swapper/320:48:523
69905199200,19cyclictest0-21swapper/320:21:073
699047992018,1cyclictest0-21swapper/223:14:342
699047992018,1cyclictest0-21swapper/222:19:042
699047992018,1cyclictest0-21swapper/221:46:532
699047992018,1cyclictest0-21swapper/221:37:402
699047992018,1cyclictest0-21swapper/220:48:472
699047992018,1cyclictest0-21swapper/220:48:462
699047992018,1cyclictest0-21swapper/220:27:312
699047992018,1cyclictest0-21swapper/220:05:132
699047992018,1cyclictest0-21swapper/219:20:452
699047992018,1cyclictest0-21swapper/200:32:332
699047992012,6cyclictest730657-21cron20:40:002
69904799200,19cyclictest0-21swapper/223:24:062
69904799200,19cyclictest0-21swapper/222:07:202
69904799200,19cyclictest0-21swapper/200:35:582
699045992018,1cyclictest0-21swapper/123:10:191
699045992015,3cyclictest747239-21grep21:25:111
69904599200,1cyclictest0-21swapper/123:06:401
699041992018,1cyclictest0-21swapper/022:55:530
699041992018,1cyclictest0-21swapper/022:30:520
699041992018,1cyclictest0-21swapper/022:27:130
699041992017,2cyclictest1895009-21snapd23:33:430
699041992016,3cyclictest2156-21gnome-shell23:37:080
699041992014,4cyclictest808336-21perf00:20:010
69904199200,1cyclictest0-21swapper/023:02:420
69904199200,1cyclictest0-21swapper/022:45:030
69904199200,1cyclictest0-21swapper/022:45:030
69904199200,1cyclictest0-21swapper/021:50:280
69904199200,1cyclictest0-21swapper/020:42:500
69904199200,19cyclictest3056-21PK-Backend23:11:400
69904199200,19cyclictest0-21swapper/023:55:270
69904199200,19cyclictest0-21swapper/022:40:030
69904199200,19cyclictest0-21swapper/022:09:020
69904199200,19cyclictest0-21swapper/021:55:490
69904199200,19cyclictest0-21swapper/020:27:000
69904199200,19cyclictest0-21swapper/000:35:300
69904199200,19cyclictest0-21swapper/000:09:330
69904199200,18cyclictest746802-21sh21:25:000
139099200,14rtkit-daemon0-21swapper/200:12:552
699051991917,1cyclictest3056-21PK-Backend23:00:263
699051991916,2cyclictest411rcuc/321:30:003
699051991913,4cyclictest42-21ksoftirqd/300:00:153
69905199190,7cyclictest42-21ksoftirqd/323:15:123
69905199190,5cyclictest3056-21PK-Backend21:43:453
69905199190,1cyclictest3056-21PK-Backend22:53:363
699047991917,1cyclictest0-21swapper/222:53:512
699047991917,1cyclictest0-21swapper/222:32:282
699047991917,1cyclictest0-21swapper/222:22:082
699047991917,1cyclictest0-21swapper/219:50:402
699047991917,1cyclictest0-21swapper/219:50:392
699047991917,1cyclictest0-21swapper/200:05:502
699045991914,3cyclictest716060-21ntp_states19:55:171
69904599191,3cyclictest141rcu_preempt00:05:011
699045991912,6cyclictest781792-21perf23:05:001
699045991912,5cyclictest810791-21cat00:25:161
699045991912,5cyclictest758278-21cat21:55:161
699045991912,4cyclictest769586-21dump-pmu-power22:30:011
699045991912,4cyclictest1095-21runrttasks23:45:201
699045991911,6cyclictest883-21dbus-daemon20:54:591
69904599191,14cyclictest714452-21taskset19:50:201
69904599191,14cyclictest714452-21taskset19:50:191
699045991911,2cyclictest26-21ksoftirqd/120:30:011
699045991910,6cyclictest718533-21basename20:05:001
69904599190,1cyclictest0-21swapper/121:01:291
699041991917,1cyclictest0-21swapper/021:40:560
699041991917,1cyclictest0-21swapper/021:37:520
699041991917,1cyclictest0-21swapper/020:47:300
699041991917,1cyclictest0-21swapper/020:47:300
699041991917,1cyclictest0-21swapper/020:13:570
699041991917,1cyclictest0-21swapper/019:45:510
699041991913,5cyclictest760038-21memory22:00:180
699041991912,5cyclictest749836-21pluginstate21:30:210
699041991911,6cyclictest730668-21/usr/sbin/munin20:40:010
69904199190,1cyclictest3056-21PK-Backend00:00:130
69904199190,1cyclictest0-21swapper/023:27:500
69904199190,1cyclictest0-21swapper/021:08:520
69904199190,18cyclictest0-21swapper/021:25:140
69904199190,18cyclictest0-21swapper/020:32:350
69904199190,18cyclictest0-21swapper/019:50:240
69904199190,18cyclictest0-21swapper/019:50:240
7382672180,3sleep33056-21PK-Backend21:00:113
69905199182,6cyclictest42-21ksoftirqd/321:20:333
69905199181,6cyclictest42-21ksoftirqd/322:56:013
69905199180,6cyclictest730656-21perf20:40:003
69905199180,6cyclictest3056-21PK-Backend21:56:083
69905199180,6cyclictest3056-21PK-Backend00:20:213
699047991816,1cyclictest0-21swapper/221:23:072
699047991816,1cyclictest0-21swapper/219:55:272
699047991816,1cyclictest0-21swapper/219:48:162
699047991816,1cyclictest0-21swapper/200:26:332
699047991812,4cyclictest1095-21runrttasks19:25:142
69904799180,1cyclictest0-21swapper/221:52:482
699045991816,1cyclictest0-21swapper/121:45:151
699045991816,1cyclictest0-21swapper/120:09:581
699045991812,4cyclictest815055-21sshd00:37:161
699045991812,4cyclictest773072-21idleruntime-cro22:39:591
699045991812,4cyclictest740008-21cpuspeed_turbos21:05:111
699045991812,4cyclictest2156-21gnome-shell22:04:091
69904599181,12cyclictest792690-21apt-get23:35:031
699045991810,5cyclictest750681-21cat21:35:021
699045991810,2cyclictest26-21ksoftirqd/121:45:001
69904599180,1cyclictest3056-21PK-Backend19:21:451
699041991816,1cyclictest0-21swapper/023:07:340
699041991816,1cyclictest0-21swapper/019:42:050
699041991812,5cyclictest716551-21sshd19:57:160
699041991810,6cyclictest797123-21cat23:45:220
139099180,15rtkit-daemon0-21swapper/121:35:221
69905199175,7cyclictest42-21ksoftirqd/321:30:023
699051991715,1cyclictest3056-21PK-Backend23:05:533
699051991714,2cyclictest411rcuc/323:14:073
699047991715,1cyclictest0-21swapper/223:38:342
699047991714,2cyclictest750135-21users21:30:232
699047991711,5cyclictest711669-21sed19:45:002
699047991710,5cyclictest798671-21ntp_states23:50:182
69904599173,9cyclictest776789-21apt22:50:121
699045991712,3cyclictest26-21ksoftirqd/122:35:011
699045991711,4cyclictest810097-21idleruntime-cro00:25:001
69904599171,12cyclictest765518-21python322:15:191
69904599171,12cyclictest436-20systemd-journal19:30:001
699045991710,5cyclictest787397-21grep23:20:121
69904599170,5cyclictest0-21swapper/121:10:381
69904199179,6cyclictest719731-21wc20:05:220
69904199178,8cyclictest717515-21cat20:00:170
699041991714,2cyclictest735028-21df20:50:120
699041991712,3cyclictest805886-21sh00:10:190
699041991712,3cyclictest767474-21vmstat22:20:210
699041991711,5cyclictest809084-21irqstats00:20:160
699041991711,5cyclictest777321-21cat22:50:170
699041991710,6cyclictest737429-21sed20:55:200
699041991710,5cyclictest745251-21cut21:20:010
69904199170,3cyclictest701452-21apt19:15:120
69905199161,6cyclictest42-21ksoftirqd/321:14:313
69904799168,6cyclictest797646-21cron23:49:592
699047991611,3cyclictest708475-21cpuspeed_turbos19:35:102
69904599169,5cyclictest2156-21gnome-shell23:16:091
69904599168,6cyclictest918-21rs:main1
699045991614,1cyclictest3056-21PK-Backend19:31:241
69904599161,12cyclictest725462-21awk20:25:001
69904599160,1cyclictest141rcu_preempt23:59:451
699041991614,1cyclictest0-21swapper/022:11:320
699041991614,1cyclictest0-21swapper/019:23:410
69904199161,11cyclictest771589-21apt22:35:110
139099160,13rtkit-daemon0-21swapper/119:48:461
69904799158,5cyclictest883-21dbus-daemon22:48:042
69904799158,5cyclictest883-21dbus-daemon22:48:042
699047991513,1cyclictest0-21swapper/220:34:272
699047991511,3cyclictest741839-21/usr/sbin/munin21:10:112
69904599158,5cyclictest2156-21gnome-shell23:51:081
699045991513,1cyclictest3056-21PK-Backend19:12:121
699045991511,2cyclictest26-21ksoftirqd/119:35:141
69904599150,14cyclictest3056-21PK-Backend20:43:441
699041991511,3cyclictest754232-21/usr/sbin/munin21:45:110
69904799148,4cyclictest717200-21tr20:00:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional