You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 04:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Tue Mar 31, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1054276994736,8cyclictest391ktimers/322:15:133
1054267994740,4cyclictest1092514-21munin-plugin-st21:00:001
1054271994614,6cyclictest0-21swapper/223:15:252
1054271994517,25cyclictest0-21swapper/222:10:282
1054276994433,8cyclictest391ktimers/320:50:133
1054271994417,3cyclictest0-21swapper/222:15:182
1054267994435,5cyclictest1127676-21auditctl22:40:001
1054271994317,4cyclictest0-21swapper/219:20:252
1054276994217,17cyclictest645-21runrttasks23:55:163
1054271994214,6cyclictest0-21swapper/219:45:022
1054271994213,5cyclictest0-21swapper/223:30:012
1054267994233,6cyclictest1086989-21unixbench_singl20:40:261
1054267994233,5cyclictest1066280-21unixbench_multi19:40:251
1054262994229,10cyclictest121ktimers/020:10:120
1054267994133,4cyclictest1112940-21unixbench_multi21:55:281
1054267994133,4cyclictest1112940-21unixbench_multi21:55:271
1054267994132,6cyclictest1062875-21unixbench_multi19:30:261
1054267994131,6cyclictest1078670-21munin-plugin-st20:20:011
1054262994134,4cyclictest1144741-21idleruntime-cro23:30:000
1054271994013,5cyclictest0-21swapper/200:00:002
1054267994031,4cyclictest0-21swapper/100:25:001
1054262994034,4cyclictest1122457-21kworker/u8:2+events_unbound23:22:440
1054262994033,4cyclictest1090814-21idleruntime-cro20:55:000
1054262994032,5cyclictest1099566-21sendmail21:20:000
1054276993922,12cyclictest0-21swapper/300:15:123
1054271993916,3cyclictest0-21swapper/220:55:012
1054267993932,4cyclictest1085699-21munin-plugin-st20:40:011
1054267993929,6cyclictest1116605-21unixbench_singl22:05:261
1054267993929,6cyclictest0-21swapper/119:25:261
1054262993927,7cyclictest0-21swapper/000:20:260
1054276993827,8cyclictest1148143-21cron23:40:003
1054276993827,7cyclictest1164670-21/usr/sbin/munin00:25:253
1054276993827,7cyclictest1164670-21/usr/sbin/munin00:25:253
1054276993819,4cyclictest1106191-21users21:35:273
1054271993813,4cyclictest0-21swapper/221:15:172
1054271993811,8cyclictest1057807-21users19:15:272
1054267993829,4cyclictest0-21swapper/119:45:171
1054262993829,6cyclictest0-21swapper/022:00:000
1054262993829,6cyclictest0-21swapper/022:00:000
1054262993825,8cyclictest121ktimers/019:30:140
1054276993729,5cyclictest1073076-21unixbench_multi20:00:263
1054276993726,7cyclictest1138830-21/usr/sbin/munin23:10:243
1054276993723,11cyclictest1159055-21/usr/sbin/munin00:10:193
1054276993723,11cyclictest1131436-21/usr/sbin/munin22:50:143
1054276993723,11cyclictest1086220-21/usr/sbin/munin20:40:173
1054276993722,9cyclictest0-21swapper/322:05:133
1054271993724,8cyclictest1067984-21grep19:45:262
1054271993717,3cyclictest0-21swapper/221:35:002
1054267993730,4cyclictest1071856-21sendmail20:00:001
1054267993728,4cyclictest0-21swapper/119:20:261
1054276993626,7cyclictest1128492-21/usr/sbin/munin22:40:213
1054276993626,7cyclictest1058896-21/usr/sbin/munin19:20:193
1054276993626,5cyclictest0-21swapper/322:32:333
1054276993625,7cyclictest1077721-21/usr/sbin/munin20:15:203
1054276993625,7cyclictest1068665-21munin-node19:50:113
1054276993625,6cyclictest0-21swapper/321:12:153
1054276993624,9cyclictest1117593-21/usr/sbin/munin22:10:173
1054276993624,9cyclictest1113400-21apt-get22:00:053
1054276993623,10cyclictest1108811-21/usr/sbin/munin21:45:173
1054276993622,10cyclictest1148953-21ntp_states23:40:213
1054276993621,11cyclictest1079987-21/usr/sbin/munin20:20:253
1054276993617,9cyclictest0-21swapper/323:20:093
1054271993628,4cyclictest1097836-21cron21:15:002
1054267993626,6cyclictest0-21swapper/122:45:001
1054267993625,7cyclictest0-21swapper/123:00:001
1054276993526,6cyclictest1103627-21fschecks_time21:30:163
1054276993525,7cyclictest1137043-21/usr/sbin/munin23:05:233
1054276993525,7cyclictest1124015-21cron22:27:003
1054276993525,7cyclictest1124015-21cron22:27:003
1054276993525,7cyclictest1087762-21diskstats20:45:153
1054276993522,9cyclictest1167460-21/usr/sbin/munin00:35:153
1054276993522,10cyclictest1066394-21cron19:41:013
1054276993520,11cyclictest1127191-21/usr/sbin/munin22:35:263
1054276993520,11cyclictest1110538-21if_eth121:50:173
1054276993517,14cyclictest1064087-21runrttasks19:35:203
1054271993528,4cyclictest1113418-21basename22:00:002
1054271993528,4cyclictest1113418-21basename22:00:002
1054271993528,3cyclictest0-21swapper/222:40:162
1054271993522,9cyclictest0-21swapper/221:00:002
1054267993525,6cyclictest0-21swapper/120:30:011
1054267993525,6cyclictest0-21swapper/120:30:011
1054267993525,6cyclictest0-21swapper/100:35:271
1054262993526,5cyclictest1030891-21kworker/u8:3+events_unbound19:52:010
1054262993525,7cyclictest1082079-21auditctl20:30:010
1054262993525,7cyclictest1082079-21auditctl20:30:000
1054262993525,6cyclictest1165415-21apt00:30:000
1054262993525,6cyclictest1165415-21apt00:30:000
1054276993425,6cyclictest1074132-21/usr/sbin/munin20:05:193
1054276993424,7cyclictest1095305-21/usr/sbin/munin21:05:243
1054276993424,7cyclictest1082525-21/usr/sbin/munin20:30:133
1054276993424,7cyclictest1060523-21/usr/sbin/munin19:25:193
1054276993424,6cyclictest0-21swapper/320:35:163
1054276993422,9cyclictest1122350-21sshd22:22:273
1054276993422,8cyclictest1080668-21/usr/sbin/munin20:25:153
1054276993422,8cyclictest1080668-21/usr/sbin/munin20:25:153
1054276993421,10cyclictest1098209-21/usr/sbin/munin21:15:173
1054276993419,12cyclictest1100741-21/usr/sbin/munin21:20:253
1054276993418,11cyclictest1093419-21/usr/sbin/munin21:00:193
1054276993418,11cyclictest1093419-21/usr/sbin/munin21:00:193
1054276993417,13cyclictest1167105-21cron00:34:593
1054276993417,13cyclictest1135285-21ntpq23:00:203
1054276993415,15cyclictest1163524-21idleruntime-cro00:25:013
1054276993415,14cyclictest1070524-21fschecks_count19:55:173
1054271993426,4cyclictest1163561-21latency_hist00:25:012
1054271993426,4cyclictest0-21swapper/220:30:172
1054271993425,4cyclictest0-21swapper/200:30:242
1054271993422,9cyclictest311ktimers/221:25:122
1054271993422,7cyclictest1132360-21grep22:50:262
1054267993424,6cyclictest0-21swapper/123:25:261
1054267993424,6cyclictest0-21swapper/123:15:151
1054267993423,7cyclictest0-21swapper/123:55:301
1054267993423,6cyclictest0-21swapper/119:15:261
1054262993428,3cyclictest1137919-21kthreadd23:10:000
1054262993425,5cyclictest0-21swapper/000:10:260
1054262993424,7cyclictest0-21swapper/022:10:000
1054276993327,3cyclictest1156916-21apt-get00:05:163
1054276993327,3cyclictest1139846-21apt-get23:15:133
1054276993324,6cyclictest1067242-21/usr/sbin/munin19:45:183
1054276993323,7cyclictest1152050-21/usr/sbin/munin23:50:173
1054276993323,7cyclictest1145571-21/usr/sbin/munin23:30:223
1054276993323,7cyclictest1129634-21/usr/sbin/munin22:45:133
1054276993323,7cyclictest1107350-21/usr/sbin/munin21:40:213
1054276993322,7cyclictest1091614-21ntp_states20:55:223
1054276993322,7cyclictest1062298-21meminfo19:30:203
1054276993322,7cyclictest1054867-21meminfo19:10:193
1054276993320,10cyclictest1075615-21/usr/sbin/munin20:10:153
1054276993319,11cyclictest1133145-21/usr/sbin/munin22:55:153
1054276993317,11cyclictest1144924-21cat23:30:023
1054276993317,11cyclictest1056207-21sh19:15:013
1054271993326,4cyclictest1142616-21unixbench_singl23:20:222
1054267993323,6cyclictest0-21swapper/121:20:261
1054262993325,4cyclictest0-21swapper/022:40:000
1054262993324,6cyclictest1161376-21grep00:15:260
1054262993316,14cyclictest0-21swapper/019:15:010
1054276993223,7cyclictest1150428-21irqstats23:45:183
1054276993223,7cyclictest1150428-21irqstats23:45:183
1054276993221,7cyclictest1155321-21df_inode00:00:143
1054276993220,9cyclictest1111933-21/usr/sbin/munin21:55:173
1054276993220,9cyclictest1111933-21/usr/sbin/munin21:55:173
1054271993220,6cyclictest0-21swapper/200:35:272
1054267993223,6cyclictest0-21swapper/123:45:001
1054267993223,6cyclictest0-21swapper/121:15:001
1054267993222,6cyclictest0-21swapper/120:20:251
105426299322,12cyclictest1096141-21idleruntime-cro21:10:000
1054276993121,7cyclictest1101830-21diskstats21:25:153
1054267993121,6cyclictest0-21swapper/122:55:001
1054267993121,6cyclictest0-21swapper/121:45:251
1054267993121,6cyclictest0-21swapper/100:10:011
1054267993120,7cyclictest0-21swapper/122:30:261
1054262993124,3cyclictest0-21swapper/020:35:260
1054262993121,6cyclictest1122107-21grep22:20:240
1054262993120,8cyclictest1152806-21grep23:50:240
1054262993120,8cyclictest1074778-21grep20:05:260
1054271993023,3cyclictest0-21swapper/222:25:172
1054271993023,3cyclictest0-21swapper/222:25:172
1054271993021,5cyclictest0-21swapper/220:40:162
1054271993019,7cyclictest0-21swapper/223:45:002
1054267993023,4cyclictest0-21swapper/122:45:271
1054267993021,4cyclictest0-21swapper/121:50:161
1054267993020,6cyclictest0-21swapper/123:35:171
1054267993020,6cyclictest0-21swapper/100:15:251
1054262993020,6cyclictest0-21swapper/021:40:270
1054271992921,4cyclictest0-21swapper/219:25:252
1054267992921,5cyclictest0-21swapper/121:45:001
1054267992921,4cyclictest0-21swapper/119:15:001
1054267992920,6cyclictest1106101-21grep21:35:271
1054267992920,6cyclictest0-21swapper/123:05:261
1054262992922,3cyclictest0-21swapper/023:35:000
1054262992920,5cyclictest1103189-21munin-plugin-st21:30:000
1054262992919,6cyclictest1100859-21grep21:20:260
1054262992919,6cyclictest0-21swapper/000:30:240
1054262992915,9cyclictest204-21dbus-daemon22:32:330
1054271992820,3cyclictest0-21swapper/223:10:242
1054271992817,6cyclictest0-21swapper/223:37:472
1054267992820,4cyclictest0-21swapper/123:00:191
1054267992819,5cyclictest0-21swapper/121:10:011
1054267992818,7cyclictest1142614-21grep23:20:221
1054262992821,4cyclictest13550irq/42-30be0000.ethernet20:30:250
1054262992820,5cyclictest0-21swapper/022:00:260
1054262992820,4cyclictest0-21swapper/020:45:260
1054262992819,3cyclictest0-21swapper/022:25:190
1054262992819,3cyclictest0-21swapper/022:25:180
1054262992817,7cyclictest0-21swapper/023:40:000
1054262992816,6cyclictest0-21swapper/022:20:000
1054271992719,4cyclictest0-21swapper/220:20:252
1054271992717,6cyclictest0-21swapper/221:45:252
1054267992720,3cyclictest0-21swapper/122:00:131
1054267992719,4cyclictest0-21swapper/123:10:261
1054267992718,6cyclictest1090389-21unixbench_singl20:50:261
1054262992718,6cyclictest0-21swapper/023:05:000
1054262992718,5cyclictest13850irq/36-mmc100:39:590
1054262992717,7cyclictest1064534-21grep19:35:250
105426299271,5cyclictest1078912-21apt-get20:20:130
1054271992617,4cyclictest0-21swapper/219:52:012
1054271992614,7cyclictest0-21swapper/222:45:262
1054267992618,4cyclictest0-21swapper/121:02:121
1054267992618,4cyclictest0-21swapper/121:02:121
1054267992618,4cyclictest0-21swapper/100:30:001
1054267992618,4cyclictest0-21swapper/100:30:001
105426299262,7cyclictest1158380-21latency_hist00:10:000
105426299262,5cyclictest1092517-21munin-run21:00:000
1054262992617,5cyclictest0-21swapper/022:49:240
1054271992518,4cyclictest0-21swapper/221:20:262
1054271992518,3cyclictest0-21swapper/223:30:262
1054271992517,4cyclictest1117027-21sh22:10:002
1054271992517,4cyclictest1065037-21sendmail19:40:012
1054267992517,4cyclictest0-21swapper/123:50:241
1054267992517,4cyclictest0-21swapper/122:25:011
1054267992516,6cyclictest0-21swapper/121:30:001
1054267992516,5cyclictest0-21swapper/100:15:001
1054262992517,4cyclictest1093956-21tail21:00:250
1054262992517,4cyclictest1093956-21tail21:00:250
1054262992517,4cyclictest0-21swapper/023:40:240
1054262992516,6cyclictest1133750-21cut22:55:250
1054262992516,4cyclictest0-21swapper/019:15:260
105426299251,5cyclictest1072089-21apt-get20:00:120
1054262992515,6cyclictest0-21swapper/019:25:260
1054262992512,9cyclictest204-21dbus-daemon21:52:280
1054271992417,3cyclictest0-21swapper/200:10:262
1054271992416,4cyclictest1094021-21unixbench_singl21:00:262
1054271992416,4cyclictest1094021-21unixbench_singl21:00:252
1054271992416,4cyclictest0-21swapper/222:40:002
1054271992416,4cyclictest0-21swapper/221:50:262
1054271992413,9cyclictest1125302-21sed22:30:252
1054271992413,8cyclictest1078682-21tr20:20:002
1054267992417,3cyclictest0-21swapper/100:35:011
1054262992420,2cyclictest13550irq/42-30be0000.ethernet19:55:140
1054262992415,6cyclictest1059122-21/usr/sbin/munin19:20:220
1054262992415,6cyclictest0-21swapper/000:00:280
1054262992412,8cyclictest1129405-21basename22:45:000
105426299241,19cyclictest0-21swapper/023:48:550
105426299241,19cyclictest0-21swapper/023:48:550
105426299241,19cyclictest0-21swapper/023:17:570
105426299241,19cyclictest0-21swapper/023:13:230
1054271992316,4cyclictest311ktimers/221:40:182
1054271992315,4cyclictest0-21swapper/221:35:272
1054271992315,4cyclictest0-21swapper/219:55:272
1054267992316,5cyclictest1122457-21kworker/u8:2+events_unbound22:26:001
1054267992316,5cyclictest1122457-21kworker/u8:2+events_unbound22:26:001
1054267992315,5cyclictest0-21swapper/121:20:001
1054267992314,6cyclictest0-21swapper/123:50:011
1054267992314,6cyclictest0-21swapper/123:50:001
105426299233,14cyclictest1066742-21idleruntime-cro19:45:010
1054262992317,3cyclictest13550irq/42-30be0000.ethernet21:30:170
1054262992316,3cyclictest0-21swapper/021:14:570
1054262992316,3cyclictest0-21swapper/020:19:520
1054262992314,6cyclictest0-21swapper/022:50:250
1054262992314,5cyclictest0-21swapper/019:50:010
105426299231,3cyclictest1117028-21apt-get22:10:050
105427199227,10cyclictest311ktimers/221:05:132
105427199225,12cyclictest1156236-21grep00:00:292
1054271992215,3cyclictest1134496-21latency_hist23:00:002
1054271992212,6cyclictest1088655-21unixbench_multi20:45:252
1054267992215,4cyclictest0-21swapper/120:05:001
1054267992215,3cyclictest0-21swapper/122:15:011
1054267992214,4cyclictest0-21swapper/120:45:241
1054267992212,7cyclictest1156215-21grep00:00:281
1054267992212,6cyclictest0-21swapper/121:30:251
105426299221,17cyclictest0-21swapper/021:45:140
1054271992117,2cyclictest0-21swapper/222:05:002
1054271992116,3cyclictest1164591-21processes00:25:252
1054271992116,3cyclictest1164591-21processes00:25:242
1054271992113,5cyclictest0-21swapper/220:30:012
1054271992112,5cyclictest0-21swapper/219:10:252
1054271992110,5cyclictest1161814-21sendmail-msp00:20:002
1054267992115,4cyclictest231ktimers/120:15:001
1054267992115,3cyclictest0-21swapper/120:05:161
1054262992116,3cyclictest13550irq/42-30be0000.ethernet20:40:060
105426299211,18cyclictest0-21swapper/023:56:480
105427199209,8cyclictest1061851-21apt-get19:30:122
105427199208,7cyclictest204-21dbus-daemon20:27:072
105427199205,3cyclictest0-21swapper/222:20:112
1054271992014,4cyclictest0-21swapper/223:45:182
1054271992014,4cyclictest0-21swapper/223:45:182
1054271992013,4cyclictest1152559-21switchtime23:50:232
1054271992013,4cyclictest0-21swapper/200:05:282
1054271992011,6cyclictest0-21swapper/220:05:162
1054271992011,5cyclictest0-21swapper/220:00:252
1054271992010,7cyclictest1137394-21wc23:05:272
1054267992015,3cyclictest0-21swapper/120:30:211
1054267992014,3cyclictest0-21swapper/119:35:241
1054267992012,5cyclictest0-21swapper/123:30:201
1054271991913,3cyclictest0-21swapper/220:10:172
1054271991912,5cyclictest311ktimers/223:00:122
1054271991912,5cyclictest0-21swapper/220:35:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional