You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 18:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Aug 19, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
935121320,4sleep0147699cyclictest11:45:150
11892114103,6sleep10-21swapper/107:06:391
1202210897,6sleep20-21swapper/207:06:482
1208210789,12sleep30-21swapper/307:06:533
507721050,0sleep30-21swapper/312:14:353
1344210493,6sleep00-21swapper/007:08:390
194732860,1sleep3381ktimersoftd/309:44:163
85332780,1sleep08536-21needreboot10:05:180
85692680,1sleep20-21swapper/207:25:152
28662680,0sleep30-21swapper/307:11:023
269272660,1sleep30-21swapper/312:03:333
1476992622,2cyclictest797-21kworker/u8:210:38:010
1478992320,2cyclictest29374-21kworker/u8:109:22:022
147999220,3cyclictest5160-21sed07:16:033
1478992219,2cyclictest30081-21kworker/u8:210:11:052
1478992218,3cyclictest18598-21kworker/u8:211:57:052
147799221,19cyclictest17946-21diskmemload10:35:121
147799220,20cyclictest0-21swapper/107:55:111
1479992116,3cyclictest26260-21ssh11:30:103
1478992118,2cyclictest22557-21kworker/u8:009:47:052
1478992118,2cyclictest14817-21kworker/u8:011:46:052
1478992118,2cyclictest14817-21kworker/u8:011:22:012
1478992118,2cyclictest13745-21kworker/u8:211:00:052
1478992117,3cyclictest31887-21kworker/u8:112:26:042
147899210,18cyclictest0-21swapper/211:52:052
1476992118,2cyclictest3704-21kworker/u8:111:52:040
1476992118,2cyclictest14817-21kworker/u8:011:43:050
23822200,0sleep00-21swapper/010:32:110
1478992017,2cyclictest8132-21kworker/u8:211:25:052
1478992017,2cyclictest5348-21kworker/u8:012:17:052
147899201,17cyclictest24730-1kworker/u9:012:35:042
147799200,19cyclictest0-21swapper/111:55:041
1478991916,2cyclictest27296-21kworker/u8:110:28:052
1478991916,2cyclictest18598-21kworker/u8:212:13:042
147899190,2cyclictest0-21swapper/211:35:042
147899190,17cyclictest0-21swapper/210:06:042
1478991815,2cyclictest7980-21kworker/u8:108:09:042
1478991815,2cyclictest7714-21kworker/u8:209:03:052
1478991815,2cyclictest22326-21kworker/u8:208:12:022
1478991815,2cyclictest22326-21kworker/u8:208:12:022
147899180,2cyclictest0-21swapper/210:56:052
147899180,2cyclictest0-21swapper/209:40:042
147899180,16cyclictest0-21swapper/210:53:052
1476991815,2cyclictest28403-21kworker/u8:211:35:040
16112170,1sleep121-21rcuc/111:05:111
1478991714,2cyclictest3563-21kworker/u8:108:39:052
1478991714,2cyclictest30350-21kworker/u8:108:22:052
1478991714,2cyclictest30081-21kworker/u8:209:59:042
1478991714,2cyclictest27457-21kworker/u8:107:15:042
1478991714,2cyclictest18352-21kworker/u8:007:51:052
1478991714,2cyclictest14817-21kworker/u8:012:00:052
1478991714,2cyclictest11865-21kworker/u8:212:30:052
1476991714,2cyclictest7714-21kworker/u8:209:40:050
1476991714,2cyclictest13745-21kworker/u8:210:56:060
147999161,13cyclictest26911-21munin-run10:25:003
147999160,13cyclictest0-21swapper/312:16:063
1478991613,2cyclictest7980-21kworker/u8:107:59:042
1478991613,2cyclictest3563-21kworker/u8:108:47:052
1478991613,2cyclictest19496-21kworker/u8:011:08:052
1478991613,2cyclictest11023-21kworker/u8:207:48:052
147899160,2cyclictest0-21swapper/210:24:042
147799161,3cyclictest0-21swapper/111:04:541
147799161,2cyclictest0-21swapper/107:13:111
1477991612,2cyclictest0-21swapper/108:45:001
1476991613,2cyclictest23757-21kworker/u8:112:35:040
1476991613,2cyclictest21028-21kworker/u8:210:24:040
1476991613,2cyclictest12176-21kworker/u8:009:16:050
271932150,2sleep00-21swapper/012:03:580
147999151,12cyclictest18096-21apt-get11:55:053
147999150,13cyclictest32655-21fschecks_time10:30:143
1478991512,2cyclictest7980-21kworker/u8:107:38:052
1478991512,2cyclictest3563-21kworker/u8:108:55:052
1478991512,2cyclictest22326-21kworker/u8:208:16:012
1478991511,3cyclictest22326-21kworker/u8:208:02:022
147899151,12cyclictest0-21swapper/209:12:352
147899150,2cyclictest0-21swapper/212:20:052
147899150,13cyclictest4324-21grep11:40:162
147899150,13cyclictest3649-21snmpd09:32:092
147899150,13cyclictest28637-21ssh11:31:412
147799151,8cyclictest17946-21diskmemload12:25:011
147799151,3cyclictest0-21swapper/112:15:341
147799151,12cyclictest5751-21latency_hist07:20:011
147799151,12cyclictest16890-21sh10:46:401
147799150,3cyclictest10426-21fschecks_count07:30:131
147799150,13cyclictest0-21swapper/111:52:151
1476991512,2cyclictest29374-21kworker/u8:109:22:050
1476991512,2cyclictest14817-21kworker/u8:011:20:040
1476991512,2cyclictest13745-21kworker/u8:210:53:050
1476991512,2cyclictest0-21swapper/010:00:170
147999140,13cyclictest0-21swapper/309:45:423
147999140,12cyclictest27214-21vmstat12:36:033
147999140,12cyclictest14962-21taskset12:24:453
1478991411,2cyclictest26310-21kworker/u8:008:27:042
1478991411,2cyclictest14055-21apt-get07:40:112
147899140,9cyclictest0-21swapper/210:38:062
147899140,2cyclictest0-21swapper/211:15:052
147899140,2cyclictest0-21swapper/210:47:042
147899140,2cyclictest0-21swapper/210:41:292
147899140,2cyclictest0-21swapper/210:34:042
147899140,12cyclictest29521-21ssh12:05:402
147799149,3cyclictest0-21swapper/112:03:141
147799148,4cyclictest17946-21diskmemload09:20:351
147799142,7cyclictest0-21swapper/108:55:001
147799142,6cyclictest0-21swapper/109:34:591
147799142,6cyclictest0-21swapper/107:55:011
1477991410,2cyclictest0-21swapper/109:15:131
147799140,3cyclictest0-21swapper/110:20:391
147799140,2cyclictest0-21swapper/109:25:191
147799140,12cyclictest0-21swapper/108:20:121
1476991411,2cyclictest5348-21kworker/u8:012:20:050
1476991411,2cyclictest31887-21kworker/u8:112:09:050
1476991411,2cyclictest18598-21kworker/u8:212:12:050
1476991411,2cyclictest11023-21kworker/u8:207:32:010
147699140,2cyclictest0-21swapper/009:36:370
147699140,12cyclictest0-21swapper/012:29:300
73072130,10sleep07407-21iostat11:10:150
47392130,2sleep10-21swapper/110:01:071
312312130,2sleep00-21swapper/009:55:240
1479991310,2cyclictest0-21swapper/312:05:143
1479991310,2cyclictest0-21swapper/308:10:123
1479991310,2cyclictest0-21swapper/308:10:123
147999130,2cyclictest0-21swapper/311:26:053
147999130,2cyclictest0-21swapper/307:55:133
147999130,12cyclictest0-21swapper/312:25:143
147999130,12cyclictest0-21swapper/310:43:413
1478991310,2cyclictest0-21swapper/210:04:192
1478991310,2cyclictest0-21swapper/209:50:082
147899130,2cyclictest0-21swapper/211:10:042
147899130,2cyclictest0-21swapper/209:15:142
147899130,12cyclictest0-21swapper/210:15:092
147899130,12cyclictest0-21swapper/209:36:052
147899130,12cyclictest0-21swapper/209:29:482
147799139,2cyclictest8888-21ps07:25:181
147799138,3cyclictest29266-21cut12:05:191
147799138,3cyclictest21742-21ssh10:51:381
147799132,6cyclictest0-21swapper/112:10:001
147799132,6cyclictest0-21swapper/109:55:001
147799131,9cyclictest0-21swapper/111:40:151
1477991310,2cyclictest17946-21diskmemload12:31:001
1477991310,2cyclictest17946-21diskmemload11:20:001
1477991310,2cyclictest0-21swapper/112:35:171
1477991310,2cyclictest0-21swapper/111:10:531
1477991310,2cyclictest0-21swapper/110:30:341
1477991310,2cyclictest0-21swapper/110:26:131
1477991310,2cyclictest0-21swapper/110:05:131
1477991310,2cyclictest0-21swapper/109:56:061
1477991310,2cyclictest0-21swapper/109:45:441
1477991310,2cyclictest0-21swapper/109:44:251
1477991310,2cyclictest0-21swapper/107:45:161
1477991310,2cyclictest0-21swapper/107:20:181
147799130,2cyclictest0-21swapper/109:38:231
147799130,2cyclictest0-21swapper/109:10:201
147799130,12cyclictest17946-21diskmemload11:28:051
147799130,12cyclictest0-21swapper/111:49:231
1476991310,2cyclictest1651-21kworker/u8:111:15:050
1476991310,2cyclictest13745-21kworker/u8:211:05:050
1476991310,2cyclictest13745-21kworker/u8:211:02:040
1476991310,2cyclictest0-21swapper/012:16:080
1476991310,2cyclictest0-21swapper/011:56:050
1476991310,2cyclictest0-21swapper/010:16:510
1476991310,2cyclictest0-21swapper/009:27:180
1476991310,2cyclictest0-21swapper/009:10:190
1476991310,2cyclictest0-21swapper/008:40:490
1476991310,2cyclictest0-21swapper/008:20:170
147699130,2cyclictest29005-21sort08:15:170
147699130,2cyclictest0-21swapper/010:45:210
147699130,12cyclictest0-21swapper/012:33:380
147699130,12cyclictest0-21swapper/011:31:070
147699130,12cyclictest0-21swapper/010:13:140
147699130,11cyclictest28603-21ssh09:53:130
147999129,2cyclictest10083-21ssh11:13:153
147999129,2cyclictest0-21swapper/311:44:423
147999129,2cyclictest0-21swapper/311:18:133
147999129,2cyclictest0-21swapper/310:55:133
147999129,2cyclictest0-21swapper/310:54:543
147999129,2cyclictest0-21swapper/310:00:183
147999129,2cyclictest0-21swapper/309:30:293
147999129,2cyclictest0-21swapper/308:30:133
147999129,2cyclictest0-21swapper/307:45:143
147999127,3cyclictest0-21swapper/309:55:193
147999120,2cyclictest0-21swapper/312:32:173
147999120,2cyclictest0-21swapper/311:35:303
147999120,2cyclictest0-21swapper/311:23:553
147999120,2cyclictest0-21swapper/310:10:133
147999120,2cyclictest0-21swapper/309:15:423
147999120,2cyclictest0-21swapper/308:16:023
147999120,2cyclictest0-21swapper/307:35:143
147999120,11cyclictest0-21swapper/310:15:173
147999120,11cyclictest0-21swapper/309:20:193
147999120,10cyclictest31607-21diskmemload10:29:453
147999120,10cyclictest17946-21diskmemload09:27:583
147999120,10cyclictest0-21swapper/310:45:013
147999120,10cyclictest0-21swapper/309:35:133
147899129,2cyclictest4497-21kworker/u8:207:24:062
147899129,2cyclictest0-21swapper/208:40:152
147899120,2cyclictest0-21swapper/208:50:112
147899120,2cyclictest0-21swapper/207:30:132
147799129,2cyclictest0-21swapper/110:15:201
147799127,3cyclictest0-21swapper/111:35:131
147799121,9cyclictest14966-21missed_timers09:00:171
147799121,9cyclictest0-21swapper/107:35:151
147799121,3cyclictest0-21swapper/108:45:141
147799121,3cyclictest0-21swapper/108:00:201
147799121,3cyclictest0-21swapper/107:40:401
147799120,9cyclictest0-21swapper/110:40:121
147799120,2cyclictest0-21swapper/111:15:041
147799120,11cyclictest0-21swapper/112:26:231
147799120,11cyclictest0-21swapper/111:30:281
147799120,11cyclictest0-21swapper/110:56:351
147799120,11cyclictest0-21swapper/110:10:371
147799120,11cyclictest0-21swapper/109:05:041
147699129,2cyclictest7980-21kworker/u8:107:40:050
147699129,2cyclictest0-21swapper/011:26:010
147699129,2cyclictest0-21swapper/010:26:020
147699129,2cyclictest0-21swapper/009:46:260
147699129,2cyclictest0-21swapper/009:30:320
147699129,2cyclictest0-21swapper/008:25:300
147699129,2cyclictest0-21swapper/008:10:500
147699129,2cyclictest0-21swapper/008:10:490
147699128,2cyclictest0-21swapper/010:40:310
147699120,2cyclictest0-21swapper/008:05:120
147699120,11cyclictest0-21swapper/009:00:110
147699120,11cyclictest0-21swapper/007:55:150
147699120,11cyclictest0-21swapper/007:51:040
147699120,11cyclictest0-21swapper/007:11:050
147999118,2cyclictest0-21swapper/311:02:003
147999118,2cyclictest0-21swapper/309:05:143
147999116,3cyclictest14182-21telnet07:40:123
147999112,6cyclictest0-21swapper/307:34:013
147999110,9cyclictest20896-21ssh09:12:033
147999110,9cyclictest17946-21diskmemload09:51:593
147999110,7cyclictest0-21swapper/308:45:003
147999110,2cyclictest0-21swapper/311:45:013
147999110,2cyclictest0-21swapper/309:03:243
147999110,10cyclictest0-21swapper/311:54:273
147899110,1cyclictest0-21swapper/208:30:122
147799118,2cyclictest0-21swapper/108:30:121
147799117,2cyclictest29179-21ntpq08:15:181
147799111,7cyclictest0-21swapper/108:39:591
147799110,9cyclictest0-21swapper/108:50:141
147799110,9cyclictest0-21swapper/108:05:121
147699118,2cyclictest7980-21kworker/u8:108:00:050
147699118,2cyclictest18515-21kworker/u8:007:16:050
147699118,2cyclictest0-21swapper/007:23:430
147999107,2cyclictest0-21swapper/308:56:023
147999107,2cyclictest0-21swapper/307:23:423
147999102,7cyclictest0-21swapper/308:50:013
147999102,5cyclictest0-21swapper/308:05:013
147999100,7cyclictest0-21swapper/310:06:583
147999100,7cyclictest0-21swapper/308:21:593
147999100,2cyclictest0-21swapper/310:36:063
147799101,5cyclictest0-21swapper/108:25:121
147699107,2cyclictest3563-21kworker/u8:108:54:050
147699107,2cyclictest3563-21kworker/u8:108:49:050
147699106,2cyclictest16308-21tr07:45:120
147699100,2cyclictest0-21swapper/008:33:530
14799994,3cyclictest8157-21aten2.4-expect08:45:133
14799994,3cyclictest5004-21wc08:35:193
14799994,3cyclictest32592-21grep08:25:133
14799994,3cyclictest1533-21ssh11:05:033
14799991,6cyclictest8427-21cut07:25:143
14789994,3cyclictest0-21swapper/207:13:542
14789993,4cyclictest16168-21hostname09:05:122
14779990,2cyclictest0-21swapper/108:10:121
14779990,2cyclictest0-21swapper/108:10:111
14769996,2cyclictest0-21swapper/007:25:170
14769994,3cyclictest3688-21Xorg08:55:580
14799985,2cyclictest0-21swapper/308:00:133
14799983,3cyclictest3728-21runrttasks07:52:323
14769985,2cyclictest0-21swapper/008:36:170
14769983,3cyclictest13710-21sshd07:38:440
14769980,7cyclictest0-21swapper/009:05:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional