You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 08:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Wed Apr 22, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
936336995440,10cyclictest121ktimers/022:15:110
936349995241,7cyclictest998032-21cron22:05:013
936336995138,8cyclictest1051945-21cron00:40:000
936349994934,11cyclictest391ktimers/323:50:103
936340994936,10cyclictest985896-21idleruntime-cro21:30:001
936340994936,10cyclictest985896-21idleruntime-cro21:29:591
936349994729,14cyclictest0-21swapper/321:40:013
936349994638,5cyclictest1038086-21cron00:00:003
936349994638,5cyclictest1038086-21cron00:00:003
936345994636,6cyclictest1010987-21taskset22:40:162
936345994632,10cyclictest311ktimers/223:05:132
936349994517,23cyclictest0-21swapper/300:05:003
93634999451,40cyclictest942430-21apt-get19:25:123
93634999451,40cyclictest942430-21apt-get19:25:113
936340994532,10cyclictest231ktimers/121:35:121
936336994534,8cyclictest974794-21grep20:55:250
936349994429,11cyclictest391ktimers/320:40:123
936340994432,8cyclictest0-21swapper/122:30:001
93634999432,35cyclictest947557-21apt-get19:40:133
936349994317,22cyclictest0-21swapper/300:40:003
93634999431,3cyclictest938798-21apt-get19:15:133
93634999421,3cyclictest0-21swapper/322:10:113
936340994227,11cyclictest231ktimers/121:30:131
936340994227,11cyclictest231ktimers/121:30:131
936336994234,5cyclictest996312-21cron22:00:010
93634999412,36cyclictest937714-21sshd19:12:063
93634999412,36cyclictest937714-21sshd19:12:063
93634999411,9cyclictest998807-21/usr/sbin/munin22:05:233
93634999411,9cyclictest983167-21/usr/sbin/munin21:20:203
93634999411,9cyclictest1031805-21/usr/sbin/munin23:40:183
936349994118,19cyclictest985418-21grep21:25:263
936349994118,19cyclictest985418-21grep21:25:253
93634999410,3cyclictest0-21swapper/321:40:123
936345994131,8cyclictest311ktimers/220:50:142
93634999403,34cyclictest1020337-21/usr/sbin/munin23:05:263
93634999401,9cyclictest957982-21/usr/sbin/munin20:10:263
93634999401,8cyclictest1006905-21sshd22:29:063
93634999401,6cyclictest962185-21ntp_states20:20:223
93634999401,3cyclictest0-21swapper/323:15:123
93634999401,36cyclictest1029224-21cron23:31:003
93634999401,34cyclictest966828-21df20:35:153
93634999401,34cyclictest1045501-21diskstats00:20:153
93634999401,10cyclictest994848-21taskset21:55:113
93634999401,10cyclictest977542-21/usr/sbin/munin21:05:183
93634999401,10cyclictest963441-21/usr/sbin/munin20:25:173
936345994032,5cyclictest965009-21kworker/u8:0+events_unbound21:41:442
936345994029,8cyclictest954113-21cron20:00:012
93634999399,25cyclictest950952-21/usr/sbin/munin19:50:123
93634999393,33cyclictest1017974-21/usr/sbin/munin23:00:163
93634999392,31cyclictest965256-21/usr/sbin/munin20:30:173
93634999391,9cyclictest949773-21/usr/sbin/munin19:45:203
93634999391,8cyclictest970441-21/usr/sbin/munin20:45:143
93634999391,7cyclictest957269-21/usr/sbin/munin20:05:263
93634999391,5cyclictest1044333-21/usr/sbin/munin00:15:233
93634999391,4cyclictest1048911-21/usr/sbin/munin00:30:153
93634999391,33cyclictest976031-21ntp_states21:00:203
93634999390,11cyclictest1031027-21sshd23:37:063
936336993933,3cyclictest978644-21sh21:10:010
93634999383,31cyclictest986227-21df21:30:143
93634999383,31cyclictest986227-21df21:30:133
93634999383,30cyclictest978635-21apt-get21:10:063
93634999383,30cyclictest1042120-21cut00:10:153
93634999383,27cyclictest960634-21tr20:15:243
93634999382,32cyclictest954478-21df20:00:153
93634999382,31cyclictest993676-21grep21:50:203
93634999382,31cyclictest1016062-21df_inode22:55:153
93634999382,10cyclictest952737-21/usr/sbin/munin19:55:153
93634999381,9cyclictest946508-21/usr/sbin/munin19:35:233
93634999381,9cyclictest941244-21/usr/sbin/munin19:20:233
93634999381,8cyclictest1047752-21/usr/sbin/munin00:25:243
93634999381,7cyclictest1022848-21latency_hist23:15:013
93634999381,5cyclictest992756-21sshd21:48:053
93634999381,5cyclictest629-21snmpd22:15:543
93634999381,5cyclictest1004124-21/usr/sbin/munin22:20:183
93634999381,4cyclictest1025194-21ls23:20:203
93634999381,3cyclictest1026406-21apt-get23:25:123
93634999381,33cyclictest1034683-21cron23:49:593
93634999381,32cyclictest1012657-21df22:45:153
93634999381,32cyclictest1012657-21df22:45:153
936340993830,4cyclictest0-21swapper/121:16:411
936340993828,6cyclictest974796-21unixbench_singl20:55:251
936336993831,4cyclictest982281-21idleruntime-cro21:20:000
936336993831,4cyclictest1024455-21latency_hist23:20:000
936336993830,5cyclictest0-21swapper/021:55:010
93634999371,3cyclictest944505-21/usr/sbin/munin19:30:193
93634999371,3cyclictest944505-21/usr/sbin/munin19:30:193
93634999371,3cyclictest1007557-21/usr/sbin/munin22:30:183
93634999371,3cyclictest0-21swapper/320:50:133
93634999371,33cyclictest1040265-21fschecks_time00:05:163
93634999371,31cyclictest974748-21grep20:55:263
93634999371,10cyclictest1009336-21cat22:35:193
93634999370,3cyclictest0-21swapper/322:40:133
93634999362,30cyclictest982248-21cron21:20:013
93634999361,3cyclictest0-21swapper/322:50:113
93634999361,3cyclictest0-21swapper/322:50:113
936345993624,8cyclictest1042945-21grep00:10:262
936345993610,4cyclictest9554222grep20:00:262
936340993628,4cyclictest1045135-21cron00:20:011
936345993528,4cyclictest940275-21munin-plugin-st19:20:012
936345993525,6cyclictest1035060-21grep23:50:142
936340993528,4cyclictest1015726-21munin-plugin-st22:54:591
936340993528,4cyclictest1015726-21munin-plugin-st22:54:591
936340993527,4cyclictest0-21swapper/123:20:011
936336993529,4cyclictest0-21swapper/000:05:130
936345993427,5cyclictest945953-21kworker/u8:1+events_unbound19:41:312
936345993426,4cyclictest978631-21sh21:10:002
936345993426,4cyclictest0-21swapper/220:15:252
936345993426,4cyclictest0-21swapper/200:35:012
936340993423,7cyclictest0-21swapper/122:40:011
936345993327,4cyclictest945953-21kworker/u8:1+events_unbound20:56:412
936345993324,5cyclictest969435-21grep20:40:242
936345993324,4cyclictest0-21swapper/223:27:002
936340993326,3cyclictest0-21swapper/119:25:011
936340993325,5cyclictest0-21swapper/100:25:251
936340993325,4cyclictest0-21swapper/123:39:591
936340993325,4cyclictest0-21swapper/122:55:171
936336993326,4cyclictest0-21swapper/020:10:250
936345993225,5cyclictest1038057-21kworker/u8:0+events_unbound00:23:392
936345993224,4cyclictest0-21swapper/221:35:262
936345993224,3cyclictest0-21swapper/200:35:272
936345993223,6cyclictest957285-21grep20:05:272
936345993222,6cyclictest0-21swapper/223:45:002
936340993225,5cyclictest1012091-21kworker/u8:1+events_unbound23:42:041
936336993223,5cyclictest0-21swapper/021:20:270
936345993125,3cyclictest0-21swapper/221:20:272
936345993124,5cyclictest1031202-21kworker/u8:3+events_unbound23:58:412
936345993124,5cyclictest1031202-21kworker/u8:3+events_unbound23:58:412
936345993124,3cyclictest0-21swapper/223:15:262
936345993124,3cyclictest0-21swapper/220:25:172
93634099311,10cyclictest9531342missed_timers19:55:201
936336993125,4cyclictest1020671-21kworker/u8:2+events_unbound23:12:010
936336993123,3cyclictest0-21swapper/021:10:270
936345993021,6cyclictest0-21swapper/222:30:252
936340993023,4cyclictest0-21swapper/120:30:251
936340993022,5cyclictest943570-21kworker/u8:2+events_unbound20:01:321
936340993021,6cyclictest0-21swapper/119:45:011
936340993020,7cyclictest959570-21apt-config20:15:011
936336993024,3cyclictest0-21swapper/022:25:260
936336993023,3cyclictest0-21swapper/021:25:250
936336993023,3cyclictest0-21swapper/021:25:250
936336993022,6cyclictest11-21ksoftirqd/023:20:120
936345992923,4cyclictest1012091-21kworker/u8:1+events_unbound23:13:422
936345992921,4cyclictest0-21swapper/220:30:262
936340992922,5cyclictest965009-21kworker/u8:0+events_unbound22:16:451
936340992921,4cyclictest0-21swapper/122:30:241
936340992921,4cyclictest0-21swapper/121:20:171
936340992921,4cyclictest0-21swapper/119:30:251
936340992921,4cyclictest0-21swapper/119:30:251
936340992918,7cyclictest0-21swapper/100:00:251
936336992923,3cyclictest1019274-21latency_hist23:05:010
936336992923,3cyclictest0-21swapper/023:55:240
936336992923,3cyclictest0-21swapper/023:55:240
936336992922,5cyclictest965009-21kworker/u8:0+events_unbound20:51:400
936336992922,5cyclictest939135-21kworker/u8:3+events_unbound22:11:440
936336992921,4cyclictest0-21swapper/021:05:000
936336992919,6cyclictest0-21swapper/023:50:240
936336992918,8cyclictest0-21swapper/022:40:000
936336992918,7cyclictest0-21swapper/019:25:250
936336992918,7cyclictest0-21swapper/019:25:250
93634599283,22cyclictest944272-21fschecks_count19:30:172
93634599283,22cyclictest944272-21fschecks_count19:30:172
936345992820,5cyclictest0-21swapper/220:15:012
936345992820,4cyclictest0-21swapper/220:45:242
936345992819,4cyclictest0-21swapper/200:20:002
936345992817,7cyclictest946855-21tail19:35:262
936340992821,4cyclictest1041517-21kthreadd00:10:001
936336992820,4cyclictest0-21swapper/020:25:010
936336992816,8cyclictest204-21dbus-daemon20:31:340
936345992721,4cyclictest945953-21kworker/u8:1+events_unbound20:20:412
93634599272,14cyclictest1010380-21cron22:40:012
936345992720,5cyclictest1036263-21kworker/u8:2+events_unbound00:03:282
936345992719,3cyclictest0-21swapper/222:50:232
936345992719,3cyclictest0-21swapper/222:50:232
936345992718,7cyclictest945953-21kworker/u8:1+events_unbound19:47:212
936345992716,8cyclictest164-21systemd-journal21:30:392
936345992716,8cyclictest164-21systemd-journal21:30:392
93634099277,3cyclictest1005459-21cat22:25:021
936340992720,4cyclictest0-21swapper/121:10:011
936340992717,6cyclictest1027443-21grep23:25:251
936340992716,7cyclictest0-21swapper/123:55:241
936340992716,7cyclictest0-21swapper/123:55:231
936336992721,3cyclictest0-21swapper/023:05:180
936336992719,5cyclictest993019-21cat21:50:000
936336992719,4cyclictest0-21swapper/000:30:240
936336992715,9cyclictest121ktimers/000:00:130
936336992715,6cyclictest949435-21grep19:45:160
93633699271,23cyclictest991293-21cat21:45:010
93634599262,3cyclictest131rcu_preempt22:15:132
936345992621,3cyclictest980893-21kworker/u8:2-events_power_efficient21:15:192
936345992620,3cyclictest1003752-21apt-key22:20:022
936345992620,3cyclictest0-21swapper/222:05:192
936345992619,3cyclictest0-21swapper/221:50:252
936345992619,3cyclictest0-21swapper/220:40:012
936345992617,4cyclictest0-21swapper/222:15:012
936340992619,3cyclictest961117-21sh20:17:011
936340992619,3cyclictest0-21swapper/120:35:191
936336992620,3cyclictest0-21swapper/022:05:010
936336992619,4cyclictest0-21swapper/023:35:260
936336992619,3cyclictest0-21swapper/019:30:170
936336992619,3cyclictest0-21swapper/019:30:160
936336992617,5cyclictest0-21swapper/022:59:590
936336992616,7cyclictest955406-21unixbench_singl20:00:250
936336992615,8cyclictest938798-21apt-get19:15:120
936336992614,8cyclictest204-21dbus-daemon20:41:370
936336992614,10cyclictest13550irq/42-30be0000.ethernet22:30:110
93634599255,3cyclictest131rcu_preempt21:10:272
936345992518,4cyclictest1030873-21head23:35:272
936345992517,6cyclictest939135-21kworker/u8:3+events_unbound22:26:572
936345992517,3cyclictest0-21swapper/219:10:152
936345992517,3cyclictest0-21swapper/219:10:152
936345992516,6cyclictest1019169-21sort23:04:592
936340992519,3cyclictest0-21swapper/123:15:001
936340992519,3cyclictest0-21swapper/123:05:261
936340992519,3cyclictest0-21swapper/121:10:241
936340992516,6cyclictest0-21swapper/121:50:011
936340992514,8cyclictest946724-21sed19:35:261
936340992511,10cyclictest231ktimers/122:40:121
93633699252,6cyclictest1015295-21grep22:50:240
93633699252,6cyclictest1015295-21grep22:50:230
936336992518,3cyclictest0-21swapper/023:41:580
936336992517,5cyclictest0-21swapper/000:20:260
936336992513,9cyclictest121ktimers/021:35:140
93633699251,20cyclictest0-21swapper/022:42:160
936345992418,4cyclictest1022674-21kworker/u8:0+events_unbound23:22:392
936345992417,4cyclictest0-21swapper/221:45:262
936345992416,5cyclictest145-21jbd2/mmcblk1p2-819:20:172
936345992416,5cyclictest1022674-21kworker/u8:0+events_unbound23:47:042
936345992416,5cyclictest0-21swapper/221:55:252
936340992418,3cyclictest0-21swapper/121:50:171
936340992416,5cyclictest0-21swapper/100:35:271
936340992416,4cyclictest940286-21sendmail19:20:011
936340992415,6cyclictest0-21swapper/119:45:161
936336992418,3cyclictest0-21swapper/021:35:010
936336992418,3cyclictest0-21swapper/021:35:010
936336992418,3cyclictest0-21swapper/019:20:210
936336992414,7cyclictest937180-21find19:10:240
936336992414,7cyclictest937180-21find19:10:230
93633699241,19cyclictest0-21swapper/020:26:430
93633699241,19cyclictest0-21swapper/000:26:060
936345992317,4cyclictest943570-21kworker/u8:2+events_unbound19:29:122
936345992317,4cyclictest943570-21kworker/u8:2+events_unbound19:29:122
936345992314,5cyclictest1016950-21tail22:55:262
936345992313,6cyclictest0-21swapper/219:55:002
93634099238,3cyclictest9634312df_inode20:25:151
936340992317,3cyclictest0-21swapper/121:05:011
936340992317,3cyclictest0-21swapper/120:55:011
936340992316,4cyclictest0-21swapper/120:06:321
936336992316,3cyclictest0-21swapper/023:46:340
936336992316,3cyclictest0-21swapper/020:05:080
936336992314,5cyclictest0-21swapper/022:06:410
936336992314,3cyclictest0-21swapper/000:15:250
936336992313,5cyclictest953624-21date19:55:260
93633699231,18cyclictest0-21swapper/020:18:390
93633699230,19cyclictest0-21swapper/023:33:280
936345992216,3cyclictest0-21swapper/200:25:232
936345992215,5cyclictest945953-21kworker/u8:1+events_unbound21:01:212
936345992215,3cyclictest0-21swapper/200:05:262
936345992213,6cyclictest980893-21kworker/u8:2+events_unbound21:28:132
936345992213,6cyclictest980893-21kworker/u8:2+events_unbound21:28:132
936345992212,6cyclictest0-21swapper/223:30:242
936340992216,3cyclictest0-21swapper/123:50:221
936340992216,3cyclictest0-21swapper/123:05:001
936340992212,6cyclictest0-21swapper/119:25:251
936340992212,6cyclictest0-21swapper/119:25:251
936336992215,3cyclictest0-21swapper/019:39:260
936336992212,7cyclictest204-21dbus-daemon00:12:050
93633699221,12cyclictest645-21runrttasks22:46:200
93633699221,12cyclictest645-21runrttasks22:46:200
93633699220,18cyclictest0-21swapper/022:22:200
93633699220,18cyclictest0-21swapper/020:47:210
93634099213,4cyclictest131rcu_preempt00:30:101
936340992115,3cyclictest0-21swapper/123:45:201
936340992115,3cyclictest0-21swapper/123:30:231
936340992115,3cyclictest0-21swapper/122:00:251
936340992115,3cyclictest0-21swapper/120:25:001
936340992113,5cyclictest0-21swapper/120:40:161
936340992112,6cyclictest0-21swapper/121:40:201
936340992111,6cyclictest0-21swapper/100:10:261
93633699210,19cyclictest0-21swapper/020:36:090
936340992015,3cyclictest231ktimers/121:55:131
936340992015,3cyclictest0-21swapper/100:24:451
936340992013,5cyclictest231ktimers/122:46:151
936340992013,5cyclictest231ktimers/122:46:141
936340992013,5cyclictest231ktimers/119:50:121
936340992013,4cyclictest936676-21fschecks_time19:10:151
936340992013,4cyclictest936676-21fschecks_time19:10:151
936340992012,5cyclictest945953-21kworker/u8:1+events_unbound20:45:061
936340992011,6cyclictest0-21swapper/122:10:001
93633699200,18cyclictest0-21swapper/023:25:040
93634099199,7cyclictest1025924-21seq23:22:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional