You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 00:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sat Mar 21, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
985275994938,7cyclictest231ktimers/110:15:121
985275994437,4cyclictest1044448-21cron09:59:591
985275994229,9cyclictest1055946-21grep10:30:261
985274994233,6cyclictest1064458-21unixbench_multi10:55:260
985280994134,4cyclictest1066856-21munin-plugin-st11:05:012
985280994132,6cyclictest990487-21grep07:20:252
985280994033,5cyclictest1020285-21kworker/u8:2+events_unbound09:15:542
985275994030,6cyclictest1089227-21munin-plugin-st12:10:001
985275994029,5cyclictest0-21swapper/111:19:591
985274994032,5cyclictest1073888-21munin-plugin-st11:24:590
985274994031,6cyclictest1012050-21fschecks_time08:25:170
985280993931,4cyclictest0-21swapper/208:25:452
985280993829,6cyclictest311ktimers/212:35:122
985275993831,3cyclictest0-21swapper/108:35:011
985275993819,6cyclictest131rcu_preempt07:44:591
985274993827,6cyclictest0-21swapper/011:35:250
985274993827,6cyclictest0-21swapper/011:35:250
985288993727,7cyclictest0-21swapper/310:15:253
985280993725,8cyclictest1043996-21grep09:55:272
985280993725,8cyclictest0-21swapper/210:55:272
985275993727,6cyclictest208-21systemd-logind12:31:141
985274993728,6cyclictest1002619-21unixbench_multi07:55:250
985274993728,6cyclictest0-21swapper/009:15:160
985274993726,7cyclictest0-21swapper/010:20:260
985274993725,7cyclictest0-21swapper/010:35:250
985288993626,6cyclictest0-21swapper/307:55:363
985288993625,7cyclictest0-21swapper/308:10:263
985275993628,4cyclictest0-21swapper/108:10:151
985275993626,7cyclictest0-21swapper/109:45:271
985275993624,8cyclictest1098979-21grep12:35:241
985288993525,6cyclictest0-21swapper/309:05:163
985280993528,4cyclictest1082403-21munin-plugin-st11:50:002
985280993525,6cyclictest1049125-21grep10:10:252
985280993525,6cyclictest1049125-21grep10:10:242
985275993525,6cyclictest1061517-21munin-plugin-st10:50:001
985275993525,6cyclictest1061517-21munin-plugin-st10:50:001
985275993512,6cyclictest0-21swapper/109:45:011
985274993529,3cyclictest1099442-21kthreadd12:39:590
985274993527,4cyclictest0-21swapper/010:05:580
985274993526,5cyclictest0-21swapper/008:25:000
985274993524,7cyclictest0-21swapper/008:35:010
985288993426,4cyclictest0-21swapper/309:55:183
985288993424,6cyclictest0-21swapper/309:40:233
985280993428,3cyclictest0-21swapper/208:55:012
985280993425,5cyclictest0-21swapper/207:45:002
985275993424,7cyclictest1025234-21grep09:00:241
985275993423,7cyclictest0-21swapper/110:05:201
985274993421,5cyclictest10598242basename10:45:010
985288993327,4cyclictest1001602-21kworker/u8:3+events_unbound08:15:433
985288993326,4cyclictest0-21swapper/310:45:153
985288993326,4cyclictest0-21swapper/310:45:153
985288993325,4cyclictest0-21swapper/308:35:263
985280993326,4cyclictest0-21swapper/208:35:272
985280993324,6cyclictest0-21swapper/210:25:272
985275993325,4cyclictest0-21swapper/112:15:141
985275993324,4cyclictest131rcu_preempt07:22:241
985275993323,5cyclictest0-21swapper/111:35:001
985275993323,5cyclictest0-21swapper/111:35:001
985275993311,6cyclictest24-21ksoftirqd/107:28:041
985274993325,4cyclictest0-21swapper/007:40:010
985274993325,4cyclictest0-21swapper/007:40:010
985274993323,6cyclictest0-21swapper/011:05:020
985274993323,6cyclictest0-21swapper/010:00:170
985288993224,5cyclictest0-21swapper/311:25:233
985288993222,6cyclictest0-21swapper/307:50:263
985280993227,3cyclictest965125-21kworker/u8:1+events_unbound07:30:232
985280993225,4cyclictest0-21swapper/207:15:262
985280993224,4cyclictest0-21swapper/210:00:582
985280993223,5cyclictest995627-21grep07:35:222
985280993223,5cyclictest995627-21grep07:35:222
985275993226,4cyclictest221rcuc/111:59:401
985275993224,4cyclictest0-21swapper/111:20:251
985275993215,11cyclictest131rcu_preempt11:10:151
985275993210,5cyclictest131rcu_preempt12:00:431
985274993225,4cyclictest0-21swapper/008:10:260
985274993225,3cyclictest0-21swapper/010:30:240
985274993221,7cyclictest0-21swapper/009:30:270
985274993221,6cyclictest0-21swapper/012:30:260
985288993125,3cyclictest0-21swapper/308:50:253
985288993121,6cyclictest0-21swapper/312:10:263
985288993121,6cyclictest0-21swapper/311:30:243
985288993121,6cyclictest0-21swapper/311:30:243
985288993120,8cyclictest1035918-21sh09:35:013
985288993120,7cyclictest0-21swapper/311:05:003
985280993122,6cyclictest0-21swapper/209:00:002
98527599317,4cyclictest24-21ksoftirqd/109:25:181
98527599316,6cyclictest24-21ksoftirqd/108:05:251
985275993121,6cyclictest0-21swapper/111:50:001
985275993121,4cyclictest131rcu_preempt08:57:431
985275993116,4cyclictest1010156-21/usr/sbin/munin08:20:171
985275993111,5cyclictest131rcu_preempt11:40:171
985275993110,5cyclictest131rcu_preempt09:30:111
985274993125,3cyclictest0-21swapper/012:00:010
985274993124,4cyclictest0-21swapper/009:00:250
985274993123,4cyclictest0-21swapper/009:20:240
985274993121,6cyclictest0-21swapper/011:25:260
985288993023,4cyclictest0-21swapper/308:25:243
985288993022,5cyclictest0-21swapper/312:35:153
985288993022,5cyclictest0-21swapper/310:10:153
985288993022,5cyclictest0-21swapper/310:10:143
985288993020,6cyclictest0-21swapper/312:25:263
985288993019,7cyclictest0-21swapper/307:45:253
985280993023,4cyclictest0-21swapper/210:45:252
985280993023,4cyclictest0-21swapper/210:45:252
985280993021,6cyclictest1017349-21tune2fs08:40:172
985280993021,6cyclictest0-21swapper/211:10:252
985280993020,6cyclictest1015058-21gpgv08:35:002
98527599309,5cyclictest131rcu_preempt08:48:431
98527599309,5cyclictest131rcu_preempt08:35:011
98527599306,7cyclictest24-21ksoftirqd/110:15:011
98527599306,7cyclictest24-21ksoftirqd/110:15:011
985275993019,7cyclictest999048-21grep07:45:241
985275993017,6cyclictest1032311-21kworker/u8:1+events_unbound09:36:141
985275993015,9cyclictest965125-21kworker/u8:1-events_power_efficient07:11:081
985275993010,12cyclictest131rcu_preempt09:05:241
985274993024,3cyclictest1009910-21kthreadd08:20:000
985274993024,3cyclictest0-21swapper/007:50:000
985274993021,6cyclictest1054253-21sed10:25:260
985274993020,6cyclictest0-21swapper/012:00:250
985288992923,3cyclictest0-21swapper/312:20:003
985288992922,4cyclictest0-21swapper/308:05:163
985288992921,5cyclictest1055937-21unixbench_multi10:30:243
985288992921,4cyclictest0-21swapper/311:55:163
985288992918,7cyclictest0-21swapper/312:20:273
985288992918,7cyclictest0-21swapper/309:50:003
985280992923,4cyclictest1006511-21munin-plugin-st08:10:002
985280992921,6cyclictest1001798-21fschecks_time07:55:172
985280992921,4cyclictest0-21swapper/212:20:012
985280992920,4cyclictest0-21swapper/211:31:102
985280992920,4cyclictest0-21swapper/211:31:102
985280992915,10cyclictest311ktimers/210:15:112
98527599299,10cyclictest131rcu_preempt08:28:401
98527599297,5cyclictest24-21ksoftirqd/111:00:271
98527599295,8cyclictest24-21ksoftirqd/110:35:161
98527599294,6cyclictest24-21ksoftirqd/110:05:001
985275992922,4cyclictest0-21swapper/108:05:011
985275992919,7cyclictest231ktimers/110:55:181
985275992919,7cyclictest231ktimers/110:40:131
985275992919,7cyclictest1029959-21grep09:15:221
985275992917,6cyclictest131rcu_preempt12:13:091
985275992911,11cyclictest131rcu_preempt12:25:211
985275992910,5cyclictest131rcu_preempt10:20:151
985275992910,4cyclictest131rcu_preempt11:05:021
985275992910,4cyclictest131rcu_preempt09:10:111
985275992910,11cyclictest131rcu_preempt12:25:011
98527499299,15cyclictest1020538-21date08:50:000
985274992920,6cyclictest0-21swapper/011:45:240
985274992920,6cyclictest0-21swapper/008:50:260
985288992822,3cyclictest0-21swapper/311:00:003
985288992822,3cyclictest0-21swapper/308:55:343
985288992820,6cyclictest0-21swapper/308:45:263
985288992820,5cyclictest1072191-21idleruntime-cro11:20:003
985288992818,6cyclictest0-21swapper/310:09:593
985280992821,4cyclictest985272-21cyclictest10:05:212
985280992821,4cyclictest0-21swapper/208:15:242
985280992820,5cyclictest0-21swapper/212:25:002
985280992819,6cyclictest0-21swapper/208:10:162
98527599288,5cyclictest24-21ksoftirqd/107:30:221
98527599287,6cyclictest24-21ksoftirqd/108:50:491
98527599286,5cyclictest24-21ksoftirqd/107:35:231
98527599286,5cyclictest24-21ksoftirqd/107:35:231
98527599283,6cyclictest24-21ksoftirqd/110:52:401
98527599282,6cyclictest24-21ksoftirqd/109:50:251
985275992821,4cyclictest1001174-21latency_hist07:55:011
985275992819,5cyclictest1075139-21grep11:25:261
985275992816,6cyclictest131rcu_preempt08:44:531
985275992813,9cyclictest131rcu_preempt11:51:101
985275992811,10cyclictest0-21swapper/107:16:531
985275992810,5cyclictest131rcu_preempt07:55:231
985274992822,3cyclictest0-21swapper/009:25:280
985274992821,3cyclictest0-21swapper/010:15:260
985274992821,3cyclictest0-21swapper/007:10:260
985274992818,6cyclictest0-21swapper/008:10:010
985288992719,5cyclictest0-21swapper/311:20:243
985288992719,5cyclictest0-21swapper/307:40:013
985288992719,5cyclictest0-21swapper/307:40:013
985288992719,4cyclictest0-21swapper/311:35:263
985288992719,4cyclictest0-21swapper/311:35:263
985288992717,6cyclictest0-21swapper/311:05:253
985280992720,4cyclictest0-21swapper/209:30:272
98527599275,6cyclictest24-21ksoftirqd/111:35:161
98527599275,6cyclictest24-21ksoftirqd/111:35:161
98527599272,7cyclictest24-21ksoftirqd/108:15:191
985275992718,6cyclictest231ktimers/109:20:111
985274992720,4cyclictest13850irq/36-mmc107:20:010
985274992720,3cyclictest0-21swapper/012:21:150
985274992718,5cyclictest0-21swapper/008:40:250
985274992717,6cyclictest0-21swapper/009:50:250
985288992620,4cyclictest1051248-21kworker/u8:3+events_unbound10:21:033
985288992619,4cyclictest0-21swapper/310:35:233
985288992619,4cyclictest0-21swapper/309:15:233
985288992618,5cyclictest1032534-21munin-plugin-st09:25:013
985288992617,6cyclictest0-21swapper/308:35:013
985280992620,3cyclictest0-21swapper/212:25:262
985280992619,4cyclictest1072178-21sendmail11:20:002
985280992619,4cyclictest0-21swapper/208:20:162
985288992520,3cyclictest1084261-21latency_hist11:55:023
985288992519,3cyclictest0-21swapper/312:00:193
985288992519,3cyclictest0-21swapper/307:20:013
985288992517,6cyclictest0-21swapper/312:10:013
985288992516,6cyclictest1010736-21ntpq08:20:213
985288992516,6cyclictest0-21swapper/310:05:003
985288992514,8cyclictest992263-21users07:25:273
985280992518,4cyclictest1084077-21kworker/u8:0+events_unbound12:06:152
985280992518,4cyclictest1037172-21grep09:35:252
985280992518,4cyclictest0-21swapper/210:50:172
985280992515,7cyclictest1061355-21kworker/u8:3+events_unbound11:08:252
98528099251,4cyclictest10598242basename10:45:002
98527499252,4cyclictest1092626-21munin-run12:20:000
985274992521,2cyclictest13550irq/42-30be0000.ethernet12:10:120
985274992518,3cyclictest0-21swapper/011:05:250
985274992517,4cyclictest0-21swapper/007:20:250
985288992417,4cyclictest0-21swapper/309:35:253
985288992416,4cyclictest1042737-21sh09:55:013
985288992415,6cyclictest0-21swapper/311:10:253
985280992417,4cyclictest1083625-21tail11:50:242
985280992417,4cyclictest0-21swapper/210:20:172
985280992415,5cyclictest0-21swapper/209:45:162
98527499243,19cyclictest0-21swapper/012:25:200
98527499243,17cyclictest0-21swapper/007:54:060
985274992417,5cyclictest0-21swapper/010:51:420
985274992417,3cyclictest0-21swapper/009:09:560
985274992415,6cyclictest1041033-21cron09:50:010
985274992414,6cyclictest1004140-21cat08:00:250
98527499241,19cyclictest0-21swapper/007:42:120
985288992317,3cyclictest0-21swapper/307:10:173
985288992316,4cyclictest1054252-21unixbench_singl10:25:273
98528099232,4cyclictest131rcu_preempt11:55:112
985280992315,5cyclictest1038916-21head09:40:242
985280992315,5cyclictest0-21swapper/212:05:012
985274992317,3cyclictest0-21swapper/010:50:020
985274992317,3cyclictest0-21swapper/010:50:020
985274992317,3cyclictest0-21swapper/009:40:140
985274992316,4cyclictest0-21swapper/009:10:240
985274992313,7cyclictest0-21swapper/008:35:210
98527499231,19cyclictest1083353-21awk11:50:230
98527499231,18cyclictest0-21swapper/011:18:410
98527499231,18cyclictest0-21swapper/010:12:000
98527499231,18cyclictest0-21swapper/010:12:000
98527499231,18cyclictest0-21swapper/007:25:530
98527499230,19cyclictest0-21swapper/009:36:550
985288992217,3cyclictest0-21swapper/308:40:123
985288992216,3cyclictest0-21swapper/307:40:173
985288992215,4cyclictest1097941-21latency_hist12:35:013
985288992213,6cyclictest989897-21cat07:20:183
985280992215,5cyclictest311ktimers/211:25:212
985280992214,5cyclictest1028159-21ntpq09:10:202
985280992214,5cyclictest0-21swapper/207:50:182
985280992213,6cyclictest1077600-21/usr/sbin/munin11:35:142
985280992213,6cyclictest1077600-21/usr/sbin/munin11:35:142
985274992215,5cyclictest1022959-21kworker/u8:0+events_unbound08:55:500
985274992215,3cyclictest0-21swapper/011:30:450
985274992215,3cyclictest0-21swapper/011:30:450
985288992115,4cyclictest1028651-21unixbench_multi09:10:253
985288992115,3cyclictest1079754-21ntpq11:40:203
985288992115,3cyclictest0-21swapper/310:40:153
985288992114,5cyclictest391ktimers/308:00:133
985280992115,4cyclictest311ktimers/209:55:002
985280992115,3cyclictest0-21swapper/211:40:222
985280992115,3cyclictest0-21swapper/209:00:192
985280992114,5cyclictest1089207-21kworker/u8:2+events_unbound12:30:132
985280992114,4cyclictest982966-21kworker/u8:0+events_unbound08:03:222
985280992113,5cyclictest0-21swapper/210:35:152
985280992110,8cyclictest1033276-21awk09:25:212
98527499211,3cyclictest0-21swapper/012:06:570
98527499211,3cyclictest0-21swapper/011:40:390
985274992112,6cyclictest0-21swapper/007:30:260
98528099208,5cyclictest1055633-21mailstats10:30:242
985280992012,6cyclictest987133-21munin-setwarn07:15:012
98528099201,11cyclictest0-21swapper/209:09:312
985288991913,3cyclictest0-21swapper/310:51:073
98528099199,7cyclictest1019598-21cat08:45:252
985280991912,5cyclictest0-21swapper/207:45:162
985280991911,5cyclictest0-21swapper/209:22:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional