You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 01:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Jul 21, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17094210885,18sleep00-21swapper/007:08:110
16485210897,6sleep10-21swapper/107:05:361
17180210486,13sleep20-21swapper/207:09:182
17176210181,14sleep30-21swapper/307:09:153
288052780,0sleep00-21swapper/007:36:030
46272740,0sleep0101ktimersoftd/012:31:560
3312720,1sleep20-21swapper/210:15:132
323982620,0sleep20-21swapper/211:20:272
34022610,1sleep30-21swapper/312:30:503
17262993615,19cyclictest0-21swapper/007:10:120
1726499300,19cyclictest0-21swapper/208:15:122
17264992917,2cyclictest0-21swapper/208:30:132
91252240,0sleep00-21swapper/012:03:300
55142230,1sleep20-21swapper/212:00:062
304542230,5sleep11726399cyclictest10:12:151
17263992320,2cyclictest9894-21kworker/u8:110:29:041
1726599221,19cyclictest0-21swapper/308:20:133
17263992118,2cyclictest718-21kworker/u8:112:37:041
17263992118,2cyclictest718-21kworker/u8:112:37:031
17262992017,2cyclictest14999-21kworker/u8:210:32:050
1726299200,18cyclictest0-21swapper/008:15:120
17262991916,2cyclictest22278-21kworker/u8:210:06:040
1726499182,6cyclictest0-21swapper/209:50:012
1726499181,3cyclictest0-21swapper/210:10:132
1726399181,2cyclictest3728-21runrttasks11:40:131
17262991815,2cyclictest3678-21kworker/u8:111:31:040
17262991815,2cyclictest29425-21kworker/u8:209:49:040
17262991815,2cyclictest27691-21kworker/u8:010:41:040
17262991815,2cyclictest10125-21kworker/u8:111:04:010
17263991714,2cyclictest3678-21kworker/u8:112:19:041
17263991714,2cyclictest29425-21kworker/u8:209:50:051
17263991714,2cyclictest29425-21kworker/u8:209:06:031
17263991714,2cyclictest21051-21kworker/u8:110:40:051
17263991714,2cyclictest10125-21kworker/u8:110:59:041
1726399170,12cyclictest0-21swapper/109:27:041
1726399170,12cyclictest0-21swapper/109:27:031
1726299170,15cyclictest0-21swapper/011:40:130
123462170,1sleep21091-21diskmemload09:20:182
17265991611,3cyclictest0-21swapper/309:41:033
1726599160,14cyclictest0-21swapper/311:25:213
1726499161,3cyclictest0-21swapper/212:35:152
1726499161,3cyclictest0-21swapper/212:35:152
17263991613,2cyclictest3678-21kworker/u8:111:54:011
17263991613,2cyclictest3678-21kworker/u8:111:34:041
17263991613,2cyclictest25885-21kworker/u8:009:39:041
17263991613,2cyclictest20003-21kworker/u8:012:28:041
17263991613,2cyclictest20003-21kworker/u8:012:22:041
17263991613,2cyclictest15883-21kworker/u8:211:10:041
17263991613,2cyclictest13775-21kworker/u8:109:19:041
17263991613,2cyclictest10125-21kworker/u8:111:00:031
17262991613,2cyclictest3678-21kworker/u8:111:26:030
17262991613,2cyclictest21051-21kworker/u8:110:38:010
1726299160,14cyclictest30877-21grep12:25:200
1726599151,3cyclictest9734-21ssh10:57:243
17265991512,2cyclictest0-21swapper/309:23:313
1726599151,12cyclictest23685-21gdbus08:46:043
1726599151,12cyclictest19486-21apt-get07:15:123
1726599151,12cyclictest0-21swapper/308:36:043
1726599150,3cyclictest22912-21aten2.4_r3power10:05:133
1726599150,13cyclictest27010-21grep07:31:043
1726599150,13cyclictest0-21swapper/309:53:013
17264991510,3cyclictest9446-21wc11:30:172
17264991510,3cyclictest0-21swapper/211:41:032
1726499150,13cyclictest0-21swapper/211:55:162
17263991512,2cyclictest5438-21kworker/u8:108:08:011
17263991512,2cyclictest29425-21kworker/u8:209:20:041
17263991512,2cyclictest21614-21kworker/u8:107:46:011
17263991512,2cyclictest17032-21kworker/u8:110:09:041
17263991512,2cyclictest13775-21kworker/u8:108:50:041
17263991512,2cyclictest13775-21kworker/u8:108:47:041
1726399151,12cyclictest31056-21run-parts10:46:001
1726399150,2cyclictest31163-21ssh11:20:041
1726399150,2cyclictest1091-21diskmemload09:31:041
1726399150,2cyclictest1091-21diskmemload09:31:041
1726399150,13cyclictest0-21swapper/110:37:331
1726399150,13cyclictest0-21swapper/107:10:131
1726299151,3cyclictest16874-21hddtemp_smartct09:25:150
1726299151,3cyclictest16874-21hddtemp_smartct09:25:150
17262991512,2cyclictest3291-21kworker/u8:011:06:010
17262991512,2cyclictest3291-21kworker/u8:010:55:040
17262991512,2cyclictest29425-21kworker/u8:209:15:040
17262991512,2cyclictest0-21swapper/012:09:400
17262991511,2cyclictest8156-21ssh10:22:400
1726299151,12cyclictest2145-21ssh09:43:510
17262991510,3cyclictest3334-21aten2.4-expect07:55:140
1726299150,13cyclictest0-21swapper/012:35:430
1726299150,13cyclictest0-21swapper/012:35:430
1726599149,3cyclictest0-21swapper/312:20:153
1726599149,3cyclictest0-21swapper/312:05:193
17265991411,2cyclictest32348-21ssh11:20:213
17265991411,2cyclictest0-21swapper/312:11:213
17265991411,2cyclictest0-21swapper/312:04:513
17265991411,2cyclictest0-21swapper/310:45:203
17265991411,2cyclictest0-21swapper/307:50:113
1726599141,11cyclictest3728-21runrttasks10:10:083
1726599140,3cyclictest21732-21aten2.4-expect08:40:133
1726599140,13cyclictest0-21swapper/311:50:413
1726599140,13cyclictest0-21swapper/311:45:313
1726599140,13cyclictest0-21swapper/311:05:313
1726599140,12cyclictest0-21swapper/311:15:133
1726599140,12cyclictest0-21swapper/310:50:413
1726599140,12cyclictest0-21swapper/310:35:413
1726599140,12cyclictest0-21swapper/309:30:173
1726599140,12cyclictest0-21swapper/309:30:163
1726499142,6cyclictest0-21swapper/210:50:002
1726499142,6cyclictest0-21swapper/208:05:002
1726499142,6cyclictest0-21swapper/207:55:002
1726499142,6cyclictest0-21swapper/207:25:002
1726499141,11cyclictest20690-21ssh11:09:162
1726499140,3cyclictest0-21swapper/210:34:082
1726499140,12cyclictest0-21swapper/210:37:202
17263991411,2cyclictest13775-21kworker/u8:108:35:041
17263991411,2cyclictest13775-21kworker/u8:108:28:041
17263991411,2cyclictest0-21swapper/111:36:141
17263991411,2cyclictest0-21swapper/111:16:141
1726399140,2cyclictest0-21swapper/111:28:441
1726399140,13cyclictest0-21swapper/111:49:401
1726399140,13cyclictest0-21swapper/110:52:541
1726399140,13cyclictest0-21swapper/110:30:141
1726399140,12cyclictest0-21swapper/110:24:451
1726399140,12cyclictest0-21swapper/108:40:131
1726399140,12cyclictest0-21swapper/108:20:211
17262991411,2cyclictest9894-21kworker/u8:110:25:040
17262991411,2cyclictest29550-21kworker/u8:210:54:040
17262991411,2cyclictest29425-21kworker/u8:209:50:010
17262991411,2cyclictest15883-21kworker/u8:211:16:040
17262991411,2cyclictest12603-21kworker/u8:212:12:040
1726299141,11cyclictest21034-21ssh09:30:050
1726299141,11cyclictest21034-21ssh09:30:050
17262991410,2cyclictest0-21swapper/012:17:370
1726299140,13cyclictest0-21swapper/011:49:400
1726299140,12cyclictest4483-21ssh09:12:290
1726299140,12cyclictest0-21swapper/011:36:040
1726599132,6cyclictest0-21swapper/309:00:003
1726599132,5cyclictest0-21swapper/310:20:013
17265991310,2cyclictest0-21swapper/312:35:173
17265991310,2cyclictest0-21swapper/312:35:173
17265991310,2cyclictest0-21swapper/312:28:033
17265991310,2cyclictest0-21swapper/311:10:133
17265991310,2cyclictest0-21swapper/310:40:213
17265991310,2cyclictest0-21swapper/309:18:423
17265991310,2cyclictest0-21swapper/309:10:313
17265991310,2cyclictest0-21swapper/308:00:123
1726599130,2cyclictest0-21swapper/311:56:333
1726599130,2cyclictest0-21swapper/309:57:203
1726599130,2cyclictest0-21swapper/309:39:513
1726599130,12cyclictest11561-21ssh10:26:013
1726599130,12cyclictest0-21swapper/310:21:323
1726599130,11cyclictest0-21swapper/311:40:033
1726499139,2cyclictest9438-21rm09:50:302
1726499139,2cyclictest18717-21grep07:11:032
1726499138,3cyclictest29711-21aten2.4_r3power07:40:132
1726499138,3cyclictest0-21swapper/208:45:052
1726499132,7cyclictest0-21swapper/211:39:592
1726499132,6cyclictest0-21swapper/211:15:002
1726499132,6cyclictest0-21swapper/210:05:012
1726499132,6cyclictest0-21swapper/208:00:002
1726499132,6cyclictest0-21swapper/207:30:002
1726499131,10cyclictest20824-21ssh10:02:232
1726499131,10cyclictest0-21swapper/212:28:392
17264991310,2cyclictest0-21swapper/210:51:002
17264991310,2cyclictest0-21swapper/209:25:162
17264991310,2cyclictest0-21swapper/209:25:162
17264991310,2cyclictest0-21swapper/207:30:142
17264991310,2cyclictest0-21swapper/207:15:172
1726499130,12cyclictest0-21swapper/209:36:002
1726499130,11cyclictest1091-21diskmemload11:50:412
1726499130,11cyclictest1091-21diskmemload09:59:202
17263991310,2cyclictest3678-21kworker/u8:112:01:041
17263991310,2cyclictest26630-21kworker/u8:008:01:041
17263991310,2cyclictest26630-21kworker/u8:007:54:031
17263991310,2cyclictest0-21swapper/110:00:471
17263991310,2cyclictest0-21swapper/109:45:161
17263991310,2cyclictest0-21swapper/107:20:121
17263991310,2cyclictest0-21swapper/107:15:151
1726399130,2cyclictest0-21swapper/110:16:341
1726399130,12cyclictest0-21swapper/112:32:341
1726399130,12cyclictest0-21swapper/111:56:541
1726399130,12cyclictest0-21swapper/109:42:141
1726399130,12cyclictest0-21swapper/109:11:371
1726399130,12cyclictest0-21swapper/108:10:161
1726399130,11cyclictest0-21swapper/112:10:211
1726299131,2cyclictest19077-21pzem_current10:00:200
17262991310,2cyclictest29425-21kworker/u8:209:07:040
17262991310,2cyclictest18502-21kworker/u8:011:50:030
17262991310,2cyclictest16940-21ssh09:58:560
17262991310,2cyclictest13775-21kworker/u8:108:36:010
17262991310,2cyclictest1091-21diskmemload10:45:310
17262991310,2cyclictest0-21swapper/012:21:160
17262991310,2cyclictest0-21swapper/011:10:250
17262991310,2cyclictest0-21swapper/010:10:350
17262991310,2cyclictest0-21swapper/009:21:590
17262991310,2cyclictest0-21swapper/007:50:120
17262991310,2cyclictest0-21swapper/007:40:160
1726299130,2cyclictest0-21swapper/011:20:040
1726299130,12cyclictest0-21swapper/010:16:500
1726599129,2cyclictest0-21swapper/312:17:333
1726599129,2cyclictest0-21swapper/311:02:423
1726599129,2cyclictest0-21swapper/308:11:033
1726599127,3cyclictest29909-21tr07:40:143
1726599122,7cyclictest1091-21diskmemload10:03:593
1726599122,5cyclictest0-21swapper/308:54:593
1726599120,2cyclictest0-21swapper/311:39:263
1726599120,2cyclictest0-21swapper/309:25:133
1726599120,2cyclictest0-21swapper/309:25:133
1726599120,11cyclictest0-21swapper/311:32:223
1726599120,11cyclictest0-21swapper/310:32:343
1726599120,11cyclictest0-21swapper/308:30:203
1726499129,2cyclictest0-21swapper/209:31:102
1726499129,2cyclictest0-21swapper/209:31:102
1726499129,2cyclictest0-21swapper/208:25:192
1726499129,2cyclictest0-21swapper/207:46:022
1726499129,2cyclictest0-21swapper/207:35:182
1726499122,7cyclictest0-21swapper/211:46:022
1726499122,7cyclictest0-21swapper/210:40:022
1726499122,5cyclictest0-21swapper/210:25:002
1726499120,2cyclictest0-21swapper/212:06:552
1726499120,2cyclictest0-21swapper/211:29:102
1726499120,11cyclictest0-21swapper/209:15:202
1726499120,11cyclictest0-21swapper/208:35:152
1726399120,2cyclictest1091-21diskmemload11:07:581
1726399120,2cyclictest0-21swapper/112:05:491
1726399120,11cyclictest0-21swapper/109:55:271
1726299129,2cyclictest5438-21kworker/u8:108:13:040
1726299129,2cyclictest17703-21kworker/u8:208:45:040
1726299129,2cyclictest17607-21kworker/u8:007:17:040
1726299129,2cyclictest13775-21kworker/u8:109:03:040
1726299129,2cyclictest13775-21kworker/u8:108:30:040
1726299129,2cyclictest0-21swapper/011:55:420
1726299129,2cyclictest0-21swapper/009:36:270
1726299129,2cyclictest0-21swapper/008:01:040
1726299120,11cyclictest0-21swapper/008:40:140
1726299120,11cyclictest0-21swapper/007:45:190
1726299120,11cyclictest0-21swapper/007:20:170
1726599118,2cyclictest0-21swapper/309:48:033
1726599116,3cyclictest24929-21tail07:26:053
1726499118,2cyclictest0-21swapper/210:58:592
1726499118,2cyclictest0-21swapper/208:56:042
1726499118,2cyclictest0-21swapper/208:05:172
1726499117,2cyclictest0-21swapper/208:20:172
1726499116,3cyclictest274-21jbd2/sda1-812:35:002
1726499111,6cyclictest0-21swapper/211:16:032
1726499111,4cyclictest0-21swapper/212:20:002
1726499110,9cyclictest1091-21diskmemload12:12:232
1726499110,2cyclictest0-21swapper/211:00:092
1726499110,2cyclictest0-21swapper/210:29:542
1726399111,8cyclictest3236-21munin-node1
1726399111,8cyclictest0-21swapper/107:36:011
1726399111,6cyclictest0-21swapper/108:58:501
1726399110,9cyclictest13590-21sed08:19:591
1726399110,9cyclictest0-21swapper/109:00:121
1726399110,9cyclictest0-21swapper/107:25:201
1726599105,3cyclictest31972-21tr09:05:123
1726599105,3cyclictest17736-21grep07:10:133
1726499107,2cyclictest0-21swapper/209:40:502
1726499107,2cyclictest0-21swapper/209:10:312
1726499107,2cyclictest0-21swapper/209:05:132
1726499105,3cyclictest10094-21fschecks_time08:10:142
1726499101,6cyclictest0-21swapper/208:41:022
1726499101,5cyclictest0-21swapper/212:21:012
1726399108,1cyclictest0-21swapper/108:31:071
1726399107,2cyclictest13434-21kworker/u8:207:30:041
1726399100,2cyclictest0-21swapper/107:40:181
1726299107,2cyclictest9031-21munin-node0
1726299107,2cyclictest13775-21kworker/u8:108:51:040
1726299106,3cyclictest16859-21grep08:26:040
151902100,2sleep00-21swapper/008:22:230
172659996,2cyclictest0-21swapper/307:21:023
172659994,3cyclictest3884-21cut07:55:173
172659994,3cyclictest32555-21chrt07:45:193
172659994,3cyclictest3127-21nscd08:05:143
172659994,3cyclictest15682-21head08:25:123
172659994,3cyclictest13378-21latency_hist08:20:003
172649994,3cyclictest26009-21tr08:50:142
172629994,3cyclictest28576-21tr08:55:180
172629991,6cyclictest0-21swapper/007:28:320
172659983,3cyclictest27593-21taskset07:35:043
172659980,2cyclictest0-21swapper/309:00:123
172649983,3cyclictest29733-21taskset09:00:012
172629984,3cyclictest25830-21tr07:30:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional