You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 14:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Wed Jan 07, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
497921460,4sleep22274099cyclictest12:05:172
21502212295,19sleep20-21swapper/207:05:142
21502212295,19sleep20-21swapper/207:05:142
21933211792,17sleep30-21swapper/307:05:193
21933211792,17sleep30-21swapper/307:05:193
20924211595,15sleep10-21swapper/107:05:091
20924211595,15sleep10-21swapper/107:05:081
21732210476,20sleep00-21swapper/007:05:160
21732210476,20sleep00-21swapper/007:05:150
216102860,1sleep20-21swapper/210:36:182
102882800,5sleep02273899cyclictest09:49:120
5112780,1sleep1377-21apt-get07:35:011
264732780,0sleep10-21swapper/110:05:511
289732760,1sleep10-21swapper/111:55:271
300272750,1sleep10-21swapper/110:10:171
184622720,0sleep10-21swapper/109:21:431
67762700,0sleep20-21swapper/211:31:192
181432690,1sleep30-21swapper/308:15:253
233592210,0sleep00-21swapper/012:25:200
2274099210,19cyclictest0-21swapper/209:00:102
2273899210,19cyclictest0-21swapper/009:00:120
22741992017,2cyclictest5080-21kworker/u8:009:47:053
22741991916,2cyclictest11118-21kworker/u8:210:21:053
22741991916,2cyclictest11118-21kworker/u8:210:21:043
22739991916,2cyclictest19278-21kworker/u8:109:32:051
22739991916,2cyclictest18039-21kworker/u8:011:47:041
135002190,1sleep313503-21grep12:15:123
22740991810,3cyclictest0-21swapper/208:55:062
22739991815,2cyclictest7219-21kworker/u8:209:26:041
22739991815,2cyclictest2840-21kworker/u8:109:12:051
22739991815,2cyclictest28135-21kworker/u8:011:30:051
22739991815,2cyclictest28135-21kworker/u8:011:26:041
22739991815,2cyclictest25190-21kworker/u8:008:56:051
2273999180,2cyclictest7935-21ssh10:21:051
2273999180,2cyclictest7935-21ssh10:21:051
22741991714,2cyclictest29186-21kworker/u8:010:27:053
22741991714,2cyclictest26770-21kworker/u8:112:31:053
22741991714,2cyclictest16697-21kworker/u8:011:13:043
22739991714,2cyclictest8031-21kworker/u8:211:35:051
22739991714,2cyclictest22851-21kworker/u8:108:35:041
22739991714,2cyclictest22551-21kworker/u8:007:26:051
22739991714,2cyclictest22551-21kworker/u8:007:18:051
22739991714,2cyclictest18039-21kworker/u8:011:52:041
2273899173,8cyclictest32412-21ssh11:24:590
22741991613,2cyclictest8031-21kworker/u8:211:37:043
22741991613,2cyclictest29748-21kworker/u8:211:08:053
22741991613,2cyclictest29748-21kworker/u8:211:02:043
22741991613,2cyclictest28135-21kworker/u8:011:22:053
22741991613,2cyclictest25502-21kworker/u8:111:54:043
22741991613,2cyclictest16892-21kworker/u8:012:29:043
22740991611,3cyclictest25502-21kworker/u8:112:24:052
22739991613,2cyclictest4126-21kworker/u8:212:13:051
22739991613,2cyclictest29863-21kworker/u8:209:41:031
22739991613,2cyclictest28703-21kworker/u8:208:50:041
2273999161,13cyclictest13564-21apt-get11:40:041
2273899163,8cyclictest20521-21ssh09:25:010
22741991512,2cyclictest8031-21kworker/u8:211:57:053
22741991512,2cyclictest3695-21kworker/u8:010:59:053
22741991512,2cyclictest31070-21kworker/u8:107:39:053
22741991512,2cyclictest2840-21kworker/u8:109:02:043
22741991512,2cyclictest1495-21kworker/u8:107:11:053
22741991512,2cyclictest11118-21kworker/u8:209:57:053
22741991511,2cyclictest0-21swapper/309:10:133
2274099151,12cyclictest6703-21diskmemload10:25:172
2274099150,2cyclictest0-21swapper/208:35:112
2273999151,3cyclictest0-21swapper/110:51:161
22739991512,2cyclictest7219-21kworker/u8:209:15:041
22739991512,2cyclictest31070-21kworker/u8:107:37:041
2273999150,2cyclictest6703-21diskmemload12:31:511
2273999150,2cyclictest0-21swapper/112:29:051
2273999150,2cyclictest0-21swapper/111:08:051
2273999150,14cyclictest9023-21apt-get07:55:121
2273999150,14cyclictest0-21swapper/111:02:551
2273999150,13cyclictest6665-21cat10:55:271
2273899151,3cyclictest5536-21iostat_ios09:05:150
22738991511,2cyclictest0-21swapper/010:30:250
22738991510,3cyclictest0-21swapper/011:23:170
22738991510,3cyclictest0-21swapper/009:22:530
2273899150,3cyclictest14497-21grep11:40:120
2273899150,13cyclictest28094-21cat11:55:160
2273899150,13cyclictest11725-21cut09:15:130
2273899150,13cyclictest0-21swapper/007:50:240
2274199149,3cyclictest0-21swapper/309:50:253
22741991411,2cyclictest7219-21kworker/u8:209:19:053
22741991411,2cyclictest4126-21kworker/u8:212:14:053
22741991411,2cyclictest22093-21kworker/u8:111:19:053
22741991411,2cyclictest19719-21kworker/u8:010:41:053
22741991411,2cyclictest19278-21kworker/u8:109:38:043
22741991411,2cyclictest0-21swapper/307:15:143
2274199140,2cyclictest5367-21interrupts11:30:153
2274199140,13cyclictest0-21swapper/310:53:163
2274199140,13cyclictest0-21swapper/310:39:153
2274199140,13cyclictest0-21swapper/309:24:063
2274199140,12cyclictest6703-21diskmemload09:30:013
2274199140,12cyclictest4199-21ssh09:41:503
2274199140,12cyclictest0-21swapper/308:20:133
22740991411,2cyclictest0-21swapper/211:40:102
22740991411,2cyclictest0-21swapper/207:10:202
2274099141,11cyclictest6703-21diskmemload09:54:422
22740991410,2cyclictest0-21swapper/207:35:242
2274099140,2cyclictest0-21swapper/209:45:232
2274099140,2cyclictest0-21swapper/208:25:172
2274099140,13cyclictest0-21swapper/212:15:002
2274099140,13cyclictest0-21swapper/210:53:502
2274099140,12cyclictest6675-21snmpd09:57:512
2274099140,12cyclictest4270-21ssh10:17:542
2274099140,12cyclictest26819-21ssh12:30:102
2274099140,12cyclictest0-21swapper/211:55:072
2274099140,12cyclictest0-21swapper/210:45:112
22739991411,2cyclictest2718-21kworker/u8:007:51:051
22739991411,2cyclictest27029-21kworker/u8:208:14:041
22739991411,2cyclictest25190-21kworker/u8:008:40:051
22739991411,2cyclictest19719-21kworker/u8:010:45:051
22739991411,2cyclictest0-21swapper/110:15:211
22739991411,2cyclictest0-21swapper/109:46:521
2273999141,11cyclictest5744-21sendmail_mailtr07:45:201
2273999140,2cyclictest11695-21python10:25:241
2273999140,13cyclictest0-21swapper/111:12:421
2273999140,12cyclictest0-21swapper/112:39:461
2273999140,12cyclictest0-21swapper/107:20:211
2273899149,3cyclictest0-21swapper/012:00:580
22738991411,2cyclictest0-21swapper/012:30:110
22738991411,2cyclictest0-21swapper/007:20:190
2273899140,2cyclictest27117-21ssh10:06:580
2273899140,12cyclictest0-21swapper/011:12:300
2273899140,12cyclictest0-21swapper/010:51:090
2273899140,12cyclictest0-21swapper/010:25:140
2273899140,12cyclictest0-21swapper/009:40:110
318182130,2sleep30-21swapper/308:50:163
234872130,2sleep00-21swapper/010:03:360
22741991310,2cyclictest9089-21kworker/u8:108:06:053
22741991310,2cyclictest9089-21kworker/u8:107:57:043
22741991310,2cyclictest28703-21kworker/u8:208:45:043
22741991310,2cyclictest2840-21kworker/u8:109:05:053
22741991310,2cyclictest2718-21kworker/u8:007:54:053
22741991310,2cyclictest27029-21kworker/u8:207:44:053
22741991310,2cyclictest22851-21kworker/u8:108:32:053
22741991310,2cyclictest19278-21kworker/u8:109:25:043
22741991310,2cyclictest11118-21kworker/u8:210:16:043
22741991310,2cyclictest11118-21kworker/u8:210:10:053
22741991310,2cyclictest0-21swapper/312:23:053
22741991310,2cyclictest0-21swapper/312:01:223
22741991310,2cyclictest0-21swapper/310:30:433
22741991310,2cyclictest0-21swapper/308:35:103
2274199130,2cyclictest23728-21ssh10:03:593
2274199130,2cyclictest0-21swapper/311:28:443
2274199130,2cyclictest0-21swapper/310:06:063
2274199130,2cyclictest0-21swapper/307:20:183
2274199130,11cyclictest6703-21diskmemload10:45:273
2274099138,3cyclictest0-21swapper/209:40:142
2274099132,9cyclictest0-21swapper/209:15:122
22740991310,2cyclictest2513-21ssh11:26:502
22740991310,2cyclictest0-21swapper/212:00:302
22740991310,2cyclictest0-21swapper/211:01:532
22740991310,2cyclictest0-21swapper/210:20:262
22740991310,2cyclictest0-21swapper/210:20:262
22740991310,2cyclictest0-21swapper/210:05:182
22740991310,2cyclictest0-21swapper/209:31:212
22740991310,2cyclictest0-21swapper/209:29:222
2274099130,2cyclictest0-21swapper/211:45:322
2274099130,2cyclictest0-21swapper/210:33:352
2274099130,2cyclictest0-21swapper/210:03:352
2274099130,12cyclictest0-21swapper/211:16:402
2274099130,12cyclictest0-21swapper/209:35:172
2274099130,12cyclictest0-21swapper/207:40:192
2274099130,11cyclictest0-21swapper/212:25:132
2273999132,9cyclictest19682-21aten2.4-expect10:35:121
2273999131,3cyclictest0-21swapper/110:30:271
22739991310,2cyclictest6703-21diskmemload11:17:271
22739991310,2cyclictest3018-21sed07:40:151
22739991310,2cyclictest25190-21kworker/u8:009:09:051
22739991310,2cyclictest16892-21kworker/u8:012:20:051
22739991310,2cyclictest0-21swapper/110:02:241
2273999130,2cyclictest0-21swapper/110:43:171
2273999130,12cyclictest0-21swapper/112:08:471
2273999130,12cyclictest0-21swapper/111:20:391
2273999130,12cyclictest0-21swapper/109:35:441
2273999130,11cyclictest0-21swapper/108:25:191
2273999130,11cyclictest0-21swapper/108:21:051
2273899138,3cyclictest11686-21hddtemp_smartct09:50:150
2273899132,6cyclictest0-21swapper/011:20:000
2273899132,6cyclictest0-21swapper/008:50:000
2273899131,9cyclictest30781-21cron07:30:000
2273899131,10cyclictest9622-21munin-run11:00:010
22738991310,2cyclictest6703-21diskmemload12:17:160
22738991310,2cyclictest6703-21diskmemload12:05:070
22738991310,2cyclictest6703-21diskmemload11:34:260
22738991310,2cyclictest0-21swapper/010:20:340
22738991310,2cyclictest0-21swapper/010:20:330
22738991310,2cyclictest0-21swapper/009:14:380
2273899130,2cyclictest23732-21cut08:30:140
2273899130,2cyclictest0-21swapper/010:10:240
2273899130,12cyclictest0-21swapper/011:52:370
2273899130,12cyclictest0-21swapper/010:40:110
2273899130,11cyclictest6703-21diskmemload11:06:160
2273899130,11cyclictest6703-21diskmemload11:00:170
2273899130,11cyclictest6703-21diskmemload10:46:070
2273899130,11cyclictest6703-21diskmemload10:37:590
2273899130,11cyclictest6703-21diskmemload09:57:330
2273899130,11cyclictest0-21swapper/009:36:480
2274199129,2cyclictest20641-21kworker/u8:008:27:053
2274199129,2cyclictest0-21swapper/312:35:143
2274199129,2cyclictest0-21swapper/311:45:203
2274199129,2cyclictest0-21swapper/311:44:353
2274199120,11cyclictest0-21swapper/312:05:083
2274199120,11cyclictest0-21swapper/308:43:063
2274099129,2cyclictest6703-21diskmemload10:58:222
2274099129,2cyclictest13054-21apt-get08:05:102
2274099129,2cyclictest0-21swapper/212:35:452
2274099129,2cyclictest0-21swapper/211:50:052
2274099129,2cyclictest0-21swapper/211:20:132
2274099129,2cyclictest0-21swapper/210:13:192
2274099129,2cyclictest0-21swapper/209:10:552
2274099129,2cyclictest0-21swapper/208:40:132
2274099129,2cyclictest0-21swapper/207:30:132
2274099122,7cyclictest0-21swapper/207:59:022
2274099120,2cyclictest0-21swapper/212:10:442
2274099120,2cyclictest0-21swapper/211:38:242
2274099120,2cyclictest0-21swapper/211:12:192
2274099120,2cyclictest0-21swapper/211:05:052
2274099120,11cyclictest0-21swapper/209:22:252
2274099120,11cyclictest0-21swapper/208:30:142
2273999129,2cyclictest27029-21kworker/u8:208:18:051
2273999129,2cyclictest0-21swapper/112:15:111
2273999129,2cyclictest0-21swapper/109:51:351
2273999121,3cyclictest13051-21munin-node1
2273999121,3cyclictest0-21swapper/112:00:131
2273999121,3cyclictest0-21swapper/108:30:241
2273999120,2cyclictest0-21swapper/109:55:281
2273899129,2cyclictest6703-21diskmemload11:38:190
2273899129,2cyclictest0-21swapper/012:10:160
2273899129,2cyclictest0-21swapper/010:18:170
2273899129,2cyclictest0-21swapper/008:55:030
2273899129,2cyclictest0-21swapper/007:35:140
2273899129,2cyclictest0-21swapper/007:10:260
2273899127,3cyclictest0-21swapper/009:30:020
2273899122,7cyclictest0-21swapper/008:28:010
2273899121,9cyclictest0-21swapper/012:36:000
2273899120,2cyclictest0-21swapper/012:21:040
2273899120,2cyclictest0-21swapper/008:40:130
2273899120,11cyclictest0-21swapper/011:48:190
2273899120,11cyclictest0-21swapper/007:45:120
201592120,2sleep00-21swapper/008:20:240
2274199118,2cyclictest9089-21kworker/u8:108:13:043
2274199118,2cyclictest27029-21kworker/u8:207:47:043
2274199118,2cyclictest0-21swapper/308:55:243
2274099118,2cyclictest0-21swapper/210:42:352
2274099118,2cyclictest0-21swapper/207:15:172
2274099110,2cyclictest0-21swapper/208:46:062
2274099110,10cyclictest0-21swapper/208:50:172
2273999111,8cyclictest0-21swapper/108:00:181
2273999110,9cyclictest29226-21munin-node1
2273999110,3cyclictest0-21swapper/107:10:171
2273999110,10cyclictest0-21swapper/109:04:041
2273899118,2cyclictest0-21swapper/008:15:150
2273899112,7cyclictest0-21swapper/008:13:590
2273899112,6cyclictest0-21swapper/008:38:590
2273899110,2cyclictest0-21swapper/007:15:240
2273899110,10cyclictest0-21swapper/008:00:210
2274099107,2cyclictest0-21swapper/208:15:282
2274099107,2cyclictest0-21swapper/207:26:352
2274099102,7cyclictest0-21swapper/208:21:592
2274099102,7cyclictest0-21swapper/207:51:592
2274099102,6cyclictest0-21swapper/208:00:232
2274099101,5cyclictest0-21swapper/207:25:002
2273899105,3cyclictest32567-21unixbench_multi08:50:240
2273899105,3cyclictest31546-21grep07:30:160
2273899105,3cyclictest2940-21tr07:40:150
2273899105,3cyclictest10243-21timerandwakeup07:55:260
227419996,2cyclictest22551-21kworker/u8:007:28:053
227409991,6cyclictest0-21swapper/208:13:322
227389994,3cyclictest13796-21ls08:05:150
227419983,3cyclictest11211-21cpu08:00:143
227419980,2cyclictest0-21swapper/307:33:043
227409983,3cyclictest5544-21ntpq07:45:152
227409980,2cyclictest0-21swapper/209:06:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional