You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 14:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Aug 01, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6072211995,19sleep00-21swapper/007:05:400
5597211694,15sleep30-21swapper/307:05:153
5013210987,16sleep20-21swapper/207:05:022
680529778,6sleep10-21swapper/107:09:581
290352740,0sleep1221ktimersoftd/111:28:081
55252730,0sleep10-21swapper/111:04:231
144992730,0sleep10-21swapper/110:06:201
144992730,0sleep10-21swapper/110:06:201
95842700,0sleep10-21swapper/111:08:091
139922670,0sleep20-21swapper/208:45:172
98662660,0sleep10-21swapper/109:29:321
3752280,1sleep30-21swapper/311:31:323
683899231,3cyclictest15380-21ssh09:35:121
52932220,1sleep10-21swapper/110:30:171
684099211,18cyclictest22938-21diskmemload09:55:143
684099210,19cyclictest1090-21sed11:00:013
684099210,19cyclictest0-21swapper/309:15:113
6838992117,2cyclictest0-21swapper/110:50:141
683899210,19cyclictest0-21swapper/112:25:141
5422210,2sleep00-21swapper/009:20:100
684099200,18cyclictest0-21swapper/312:25:123
684099190,2cyclictest0-21swapper/311:53:203
684099190,2cyclictest0-21swapper/311:39:183
684099190,2cyclictest0-21swapper/307:45:133
684099190,17cyclictest0-21swapper/310:19:033
683999194,13cyclictest3127-21nscd07:30:192
683899190,17cyclictest0-21swapper/110:15:121
684099185,3cyclictest27687-21sendmail-mta12:33:383
684099180,3cyclictest26313-21sh09:12:433
684099180,2cyclictest0-21swapper/310:41:283
684099180,11cyclictest0-21swapper/309:20:093
6840991714,2cyclictest0-21swapper/310:50:143
684099170,9cyclictest0-21swapper/309:28:593
684099170,2cyclictest0-21swapper/312:03:063
684099170,2cyclictest0-21swapper/310:29:523
684099170,2cyclictest0-21swapper/309:42:383
684099170,16cyclictest0-21swapper/310:35:243
684099170,15cyclictest0-21swapper/311:29:393
684099170,11cyclictest11647-21ssh10:04:263
684099170,10cyclictest0-21swapper/311:17:193
684099170,10cyclictest0-21swapper/309:45:423
683899170,15cyclictest4139-21latency_hist10:30:011
6837991714,2cyclictest24599-21kworker/u8:012:32:050
684099167,2cyclictest0-21swapper/311:48:303
684099167,2cyclictest0-21swapper/307:57:473
684099166,2cyclictest22938-21diskmemload12:20:173
684099162,6cyclictest0-21swapper/308:01:033
684099160,2cyclictest0-21swapper/312:35:233
684099160,2cyclictest0-21swapper/309:33:213
684099160,15cyclictest0-21swapper/312:19:263
684099160,15cyclictest0-21swapper/311:41:013
683999161,3cyclictest0-21swapper/209:55:012
6839991613,2cyclictest9821-21apt-get12:15:132
6839991612,2cyclictest0-21swapper/210:55:172
683999161,13cyclictest15620-21chrt10:40:522
683999161,13cyclictest10530-21aten2.4-expect09:30:112
683999160,3cyclictest0-21swapper/211:16:132
684099155,2cyclictest22938-21diskmemload10:05:553
684099155,2cyclictest22938-21diskmemload10:05:543
684099155,2cyclictest0-21swapper/310:48:133
684099154,3cyclictest3187-21ntpd08:40:173
684099154,2cyclictest22938-21diskmemload11:00:203
684099154,2cyclictest0-21swapper/309:35:173
684099153,3cyclictest8478-21chrt07:13:233
684099153,3cyclictest4414-21munin-node3
684099153,3cyclictest22787-21chrt09:08:103
684099152,4cyclictest0-21swapper/312:11:113
684099152,3cyclictest0-21swapper/309:50:173
684099151,4cyclictest0-21swapper/307:21:023
684099151,2cyclictest0-21swapper/308:10:003
6840991512,2cyclictest0-21swapper/308:15:123
684099150,14cyclictest0-21swapper/311:56:063
684099150,14cyclictest0-21swapper/310:20:163
684099150,14cyclictest0-21swapper/310:10:303
684099150,14cyclictest0-21swapper/310:10:303
684099150,13cyclictest0-21swapper/308:12:593
684099150,10cyclictest0-21swapper/311:21:133
6839991511,2cyclictest0-21swapper/212:35:172
683999150,13cyclictest21656-21ssh11:20:172
683899151,3cyclictest5404-21cut12:10:161
6838991510,3cyclictest0-21swapper/111:53:131
683899150,13cyclictest29578-21sort10:55:191
683899150,13cyclictest27805-21latency_hist09:15:001
6837991512,2cyclictest25575-21kworker/u8:109:17:050
6837991510,3cyclictest15366-21munin-node0
300162150,3sleep00-21swapper/009:50:130
21882150,4sleep121-21rcuc/111:34:181
684099147,2cyclictest0-21swapper/307:53:443
684099144,2cyclictest31986-1kworker/u9:211:10:143
684099143,3cyclictest20756-21chrt09:02:533
684099143,3cyclictest19031-21telnet07:40:153
684099143,3cyclictest17106-21taskset08:55:073
684099143,3cyclictest1492-21grep12:06:023
684099143,2cyclictest17478-21tune2fs07:35:153
684099143,2cyclictest13629-21fschecks_time08:45:143
684099142,4cyclictest0-21swapper/308:31:023
684099140,3cyclictest6266-21ssh11:05:133
684099140,12cyclictest9201-21df_abs07:15:123
683999149,3cyclictest25623-21ssh09:11:392
683999141,2cyclictest5173-21ssh11:03:512
6839991411,2cyclictest0-21swapper/211:56:032
6839991411,2cyclictest0-21swapper/211:26:022
683999141,12cyclictest0-21swapper/210:53:372
6839991410,3cyclictest21831-21ssh12:26:312
6839991410,3cyclictest11947-21load11:10:202
683999140,2cyclictest0-21swapper/212:32:052
683999140,2cyclictest0-21swapper/210:10:192
683999140,2cyclictest0-21swapper/210:10:182
683999140,2cyclictest0-21swapper/209:40:172
683999140,2cyclictest0-21swapper/209:16:012
683999140,12cyclictest0-21swapper/211:50:172
683899149,3cyclictest11784-21ntp_states07:20:171
683899141,3cyclictest5631-21sh09:57:421
6838991410,2cyclictest13652-21ssh10:39:421
683899140,12cyclictest0-21swapper/111:55:211
683899140,12cyclictest0-21swapper/109:20:161
683899140,11cyclictest0-21swapper/112:05:451
6837991411,2cyclictest22501-21kworker/u8:212:02:050
6837991411,2cyclictest0-21swapper/012:23:370
6837991411,2cyclictest0-21swapper/011:27:170
6837991411,2cyclictest0-21swapper/011:03:470
6837991411,2cyclictest0-21swapper/010:49:070
6837991411,2cyclictest0-21swapper/009:34:570
6837991411,2cyclictest0-21swapper/007:41:060
6837991410,2cyclictest0-21swapper/009:45:000
683799140,13cyclictest26690-21ssh09:13:170
683799140,13cyclictest0-21swapper/011:56:270
683799140,13cyclictest0-21swapper/011:46:470
683799140,13cyclictest0-21swapper/011:18:260
683799140,13cyclictest0-21swapper/009:27:070
683799140,12cyclictest0-21swapper/010:57:070
684099133,3cyclictest2870-21aten2.4_r3power08:20:113
684099133,3cyclictest10537-21vmstat08:36:033
684099130,6cyclictest0-21swapper/307:33:593
6839991310,2cyclictest7216-21kworker/u8:108:35:052
6839991310,2cyclictest0-21swapper/211:41:392
6839991310,2cyclictest0-21swapper/211:33:202
6839991310,2cyclictest0-21swapper/211:06:062
6839991310,2cyclictest0-21swapper/210:25:132
6839991310,2cyclictest0-21swapper/210:01:072
6839991310,2cyclictest0-21swapper/209:55:162
6839991310,2cyclictest0-21swapper/207:36:042
683999130,2cyclictest0-21swapper/211:48:022
683999130,2cyclictest0-21swapper/211:37:152
683999130,2cyclictest0-21swapper/210:15:182
683999130,2cyclictest0-21swapper/209:35:012
683999130,2cyclictest0-21swapper/209:20:512
683999130,2cyclictest0-21swapper/207:50:192
683999130,2cyclictest0-21swapper/207:20:182
683999130,12cyclictest28954-21ssh12:00:532
683999130,12cyclictest22938-21diskmemload10:23:442
683999130,12cyclictest0-21swapper/212:20:312
683999130,12cyclictest0-21swapper/212:09:402
683999130,12cyclictest0-21swapper/210:45:312
683999130,12cyclictest0-21swapper/210:39:572
683999130,12cyclictest0-21swapper/210:31:052
683999130,12cyclictest0-21swapper/209:25:022
683999130,12cyclictest0-21swapper/209:00:202
683999130,12cyclictest0-21swapper/208:40:172
683999130,12cyclictest0-21swapper/208:00:202
683999130,12cyclictest0-21swapper/207:15:112
683999130,11cyclictest9026-21ssh12:14:192
683899138,3cyclictest7920-21diskstats10:00:151
683899138,3cyclictest27794-21ssh12:33:131
683899132,6cyclictest0-21swapper/108:55:001
683899131,10cyclictest3056-21aten2.4_r3power11:35:121
6838991310,2cyclictest0-21swapper/112:36:061
6838991310,2cyclictest0-21swapper/110:40:201
6838991310,2cyclictest0-21swapper/109:16:051
6838991310,2cyclictest0-21swapper/108:25:001
683899130,2cyclictest0-21swapper/112:20:501
683899130,2cyclictest0-21swapper/109:46:441
683899130,2cyclictest0-21swapper/109:43:331
683899130,2cyclictest0-21swapper/109:05:001
683899130,12cyclictest0-21swapper/111:10:171
683899130,11cyclictest0-21swapper/107:50:201
6837991310,2cyclictest11729-1kworker/u9:210:11:570
6837991310,2cyclictest11729-1kworker/u9:210:11:570
6837991310,2cyclictest0-21swapper/012:26:110
6837991310,2cyclictest0-21swapper/012:05:190
6837991310,2cyclictest0-21swapper/011:41:470
6837991310,2cyclictest0-21swapper/010:20:070
6837991310,2cyclictest0-21swapper/010:03:190
683799130,2cyclictest22938-21diskmemload11:38:440
683799130,2cyclictest13164-21ssh12:18:100
683799130,12cyclictest0-21swapper/011:13:210
683799130,12cyclictest0-21swapper/010:41:490
683799130,12cyclictest0-21swapper/010:25:190
683799130,12cyclictest0-21swapper/009:55:200
683799130,12cyclictest0-21swapper/009:40:420
683799130,12cyclictest0-21swapper/008:50:180
683799130,12cyclictest0-21swapper/008:40:180
683799130,12cyclictest0-21swapper/007:15:110
683799130,11cyclictest0-21swapper/010:50:050
683799130,11cyclictest0-21swapper/010:37:490
684099123,3cyclictest3153-21nscd08:50:173
683999129,2cyclictest791-21kworker/u8:008:16:002
683999129,2cyclictest7363-21kworker/u8:010:05:052
683999129,2cyclictest7363-21kworker/u8:010:05:052
683999129,2cyclictest7216-21kworker/u8:108:10:042
683999129,2cyclictest0-21swapper/207:40:222
683999120,2cyclictest0-21swapper/209:45:232
683999120,11cyclictest0-21swapper/208:50:112
683899129,2cyclictest0-21swapper/111:20:261
683899129,2cyclictest0-21swapper/110:45:461
683899129,2cyclictest0-21swapper/109:53:151
683899128,2cyclictest8814-21apt-get08:35:051
683899127,3cyclictest2834-21munin-node1
683899127,3cyclictest13096-21munin-node1
683899127,3cyclictest0-21swapper/108:10:141
683899121,9cyclictest8013-21apt-get11:40:121
683899121,9cyclictest7024-21munin-node1
683899121,9cyclictest11615-21timerwakeupswit12:16:031
683899121,9cyclictest0-21swapper/112:00:171
683899121,9cyclictest0-21swapper/111:15:121
683899121,9cyclictest0-21swapper/108:15:171
683899121,9cyclictest0-21swapper/107:55:131
6838991210,1cyclictest0-21swapper/110:20:191
683899120,2cyclictest0-21swapper/109:32:131
683899120,2cyclictest0-21swapper/108:05:171
683899120,11cyclictest0-21swapper/111:46:581
683899120,11cyclictest0-21swapper/110:10:161
683899120,11cyclictest0-21swapper/110:10:151
683899120,10cyclictest0-21swapper/108:56:041
683899120,10cyclictest0-21swapper/107:45:191
683799129,2cyclictest0-21swapper/010:05:310
683799129,2cyclictest0-21swapper/010:05:300
683799129,2cyclictest0-21swapper/009:00:170
683799129,2cyclictest0-21swapper/007:10:180
683799120,2cyclictest20513-21sh11:52:170
683799120,2cyclictest0-21swapper/011:07:180
683799120,2cyclictest0-21swapper/010:30:010
683799120,2cyclictest0-21swapper/007:50:200
683799120,2cyclictest0-21swapper/007:30:200
683799120,2cyclictest0-21swapper/007:25:120
683799120,11cyclictest0-21swapper/012:14:390
683799120,11cyclictest0-21swapper/011:31:280
683799120,11cyclictest0-21swapper/007:46:010
683799120,11cyclictest0-21swapper/007:36:020
213452120,2sleep00-21swapper/011:20:150
683999118,2cyclictest24767-21kworker/u8:007:57:042
683999118,2cyclictest0-21swapper/208:26:052
683899118,2cyclictest0-21swapper/108:40:121
683899116,3cyclictest7052-21munin-node1
683899111,7cyclictest4562-21gdm-simple-gree07:17:581
683899111,6cyclictest0-21swapper/107:32:421
683899110,9cyclictest13378-21grep07:25:141
683899110,3cyclictest27202-21munin-node1
683899110,2cyclictest0-21swapper/107:40:211
683799118,2cyclictest27205-21apt-get08:00:130
683799118,2cyclictest0-21swapper/009:05:110
683799110,2cyclictest0-21swapper/010:16:070
683799110,1cyclictest0-21swapper/008:25:000
683799110,10cyclictest0-21swapper/012:35:080
683799110,10cyclictest0-21swapper/008:31:040
684099101,3cyclictest0-21swapper/307:25:113
683999107,2cyclictest0-21swapper/208:23:122
683999107,2cyclictest0-21swapper/207:45:122
683999100,9cyclictest0-21swapper/208:56:032
683899105,3cyclictest0-21swapper/107:35:191
8492290,2sleep20-21swapper/207:13:352
68409990,2cyclictest0-21swapper/308:27:333
68399996,2cyclictest7027-21apt-get08:30:122
68399993,4cyclictest13831-21ps07:25:182
68399990,8cyclictest0-21swapper/209:06:142
68399990,2cyclictest0-21swapper/208:05:522
68389994,3cyclictest21621-21fschecks_count09:05:131
68379996,2cyclictest0-21swapper/007:55:150
68379994,3cyclictest17433-21df_abs08:55:140
68379991,7cyclictest0-21swapper/008:06:580
68379984,3cyclictest3127-21nscd08:35:140
68379984,2cyclictest898-21aten2.4_r3power08:15:130
68379984,2cyclictest12880-21latency_hist08:45:000
68379983,3cyclictest5575-21gltestperf08:25:160
68379980,6cyclictest31622-21sed08:10:150
68379970,6cyclictest0-21swapper/007:20:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional