You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 16:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue May 26, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
100762116105,6sleep10-21swapper/107:08:001
10005210796,6sleep20-21swapper/207:07:052
9971210587,13sleep30-21swapper/307:06:393
10232210381,16sleep00-21swapper/007:09:590
46642760,1sleep3381ktimersoftd/311:01:043
46642760,1sleep3381ktimersoftd/311:01:033
172502660,0sleep00-21swapper/009:33:070
143742570,1sleep229-21rcuc/212:20:102
121262310,1sleep20-21swapper/210:35:172
10260992318,3cyclictest24078-21kworker/u8:011:48:041
1026299220,20cyclictest0-21swapper/307:15:103
1026099224,16cyclictest12-21rcu_preempt08:35:121
1026099220,17cyclictest0-21swapper/111:42:051
1025999222,5cyclictest0-21swapper/007:34:020
1025999222,5cyclictest0-21swapper/007:34:010
315202210,0sleep30-21swapper/312:04:093
1026299210,19cyclictest0-21swapper/310:30:113
1026199210,19cyclictest0-21swapper/212:14:092
1026199210,19cyclictest0-21swapper/211:10:162
1026099212,2cyclictest0-21swapper/110:20:051
1025999211,18cyclictest26610-21diskmemload11:20:100
1025999211,18cyclictest19856-21ssh10:10:110
87042200,0sleep20-21swapper/209:57:582
1026199200,8cyclictest0-21swapper/212:33:492
1026199200,18cyclictest26610-21diskmemload11:54:502
1026199200,18cyclictest0-21swapper/212:19:012
10260992017,2cyclictest10977-21kworker/u8:212:18:061
95432190,0sleep10-21swapper/110:32:361
289772190,1sleep2301ktimersoftd/211:26:362
1026199191,16cyclictest17157-21apt-get11:15:112
10261991910,7cyclictest0-21swapper/210:01:002
1026199190,7cyclictest29712-21ssh09:45:492
1026199190,18cyclictest0-21swapper/207:26:012
1026199190,17cyclictest31527-21ssh10:21:192
1026199190,17cyclictest26610-21diskmemload10:57:412
1026199190,17cyclictest26610-21diskmemload10:25:232
1026199190,17cyclictest26610-21diskmemload09:39:162
1026199190,17cyclictest0-21swapper/210:53:082
1026199190,17cyclictest0-21swapper/210:45:532
1026199190,17cyclictest0-21swapper/209:17:092
10260991916,2cyclictest31691-21kworker/u8:112:29:051
10260991916,2cyclictest29096-21kworker/u8:309:29:041
10260991916,2cyclictest26791-21kworker/u8:209:47:051
10260991916,2cyclictest24949-21kworker/u8:010:59:051
1026099191,2cyclictest0-21swapper/111:58:041
1025999190,2cyclictest0-21swapper/007:25:110
1026199181,15cyclictest16451-21ssh10:05:452
1026199180,17cyclictest0-21swapper/210:12:212
1026199180,16cyclictest7034-21ssh09:22:122
1026199180,16cyclictest0-21swapper/212:03:252
1026199180,16cyclictest0-21swapper/211:41:442
1026199180,16cyclictest0-21swapper/211:24:022
10260991815,2cyclictest26182-21kworker/u8:207:51:051
10260991815,2cyclictest24078-21kworker/u8:011:22:041
10260991815,2cyclictest20294-21kworker/u8:207:39:051
10260991815,2cyclictest20294-21kworker/u8:207:39:051
10260991815,2cyclictest14168-21kworker/u8:010:38:051
10260991812,2cyclictest0-21swapper/109:52:041
1026099180,2cyclictest0-21swapper/111:01:051
1026099180,2cyclictest0-21swapper/111:01:041
1025999182,5cyclictest0-21swapper/007:18:590
1026299170,3cyclictest0-21swapper/307:20:183
1026199178,7cyclictest0-21swapper/211:06:112
1026199178,7cyclictest0-21swapper/211:06:102
10261991711,5cyclictest0-21swapper/209:10:282
1026199170,16cyclictest0-21swapper/210:43:312
1026199170,16cyclictest0-21swapper/210:31:492
1026199170,16cyclictest0-21swapper/209:40:592
1026199170,15cyclictest26610-21diskmemload11:56:092
1026199170,15cyclictest16339-21ssh09:31:412
1026199170,15cyclictest0-21swapper/212:06:052
1026199170,15cyclictest0-21swapper/209:28:152
10260991714,2cyclictest4833-21kworker/u8:209:57:051
10260991714,2cyclictest4303-21kworker/u8:008:24:041
10260991714,2cyclictest26182-21kworker/u8:207:59:051
10260991714,2cyclictest24078-21kworker/u8:011:25:051
10260991714,2cyclictest15999-21kworker/u8:111:50:051
10260991714,2cyclictest12201-21kworker/u8:008:42:051
10260991714,2cyclictest11987-21kworker/u8:107:34:051
10260991714,2cyclictest11987-21kworker/u8:107:34:041
10260991714,2cyclictest10513-21kworker/u8:110:02:041
1026099170,2cyclictest0-21swapper/109:20:051
1026099170,12cyclictest0-21swapper/112:30:041
1025999170,7cyclictest15671-21python07:21:010
10262991611,3cyclictest0-21swapper/310:14:593
1026299161,12cyclictest0-21swapper/310:50:143
10261991610,5cyclictest0-21swapper/211:30:292
1026199160,7cyclictest0-21swapper/212:25:322
1026199160,6cyclictest0-21swapper/211:48:102
1026199160,15cyclictest0-21swapper/211:35:342
1026199160,15cyclictest0-21swapper/208:00:182
1026199160,14cyclictest0-21swapper/212:37:562
10260991613,2cyclictest9330-21kworker/u8:210:44:011
10260991613,2cyclictest5036-21kworker/u8:012:13:041
10260991613,2cyclictest4344-21kworker/u8:311:07:051
10260991613,2cyclictest4344-21kworker/u8:311:07:041
10260991613,2cyclictest31691-21kworker/u8:112:36:051
10260991613,2cyclictest29096-21kworker/u8:309:18:021
10260991613,2cyclictest26182-21kworker/u8:208:00:051
10260991613,2cyclictest21938-21kworker/u8:009:06:051
10260991613,2cyclictest20919-21kworker/u8:212:02:051
10260991613,2cyclictest16382-21kworker/u8:310:12:051
10260991613,2cyclictest16382-21kworker/u8:310:08:051
10260991611,3cyclictest3728-21runrttasks10:19:551
10260991611,3cyclictest23519-21munin-node1
1025999162,7cyclictest0-21swapper/008:41:020
1025999162,5cyclictest4556-21metacity08:32:590
1026299151,12cyclictest13366-21ssh11:45:043
10262991511,2cyclictest0-21swapper/310:16:013
10262991510,3cyclictest3833-21ssh10:26:143
10262991510,3cyclictest0-21swapper/312:37:563
1026299150,3cyclictest25676-21nfs4_client09:05:163
1026299150,13cyclictest0-21swapper/309:44:243
1026199158,6cyclictest0-21swapper/211:01:562
1026199158,6cyclictest0-21swapper/211:01:552
1026199156,7cyclictest0-21swapper/210:16:352
1026199155,8cyclictest15539-21grep08:40:172
1026199154,9cyclictest26610-21diskmemload09:50:172
10261991510,3cyclictest20782-21munin-node2
10261991510,3cyclictest0-21swapper/207:15:592
1026199150,14cyclictest0-21swapper/208:45:082
1026099152,6cyclictest0-21swapper/108:55:001
10260991512,2cyclictest6704-21kworker/u8:208:26:061
10260991512,2cyclictest4303-21kworker/u8:008:16:051
10260991512,2cyclictest29096-21kworker/u8:309:33:051
10260991512,2cyclictest27748-21kworker/u8:110:27:041
10260991512,2cyclictest24949-21kworker/u8:010:54:041
10260991512,2cyclictest24078-21kworker/u8:011:31:041
10260991512,2cyclictest23221-21kworker/u8:107:46:011
10260991512,2cyclictest15712-21kworker/u8:011:15:051
10260991512,2cyclictest10209-21kworker/u8:111:12:021
1025999152,6cyclictest0-21swapper/008:12:580
10259991510,3cyclictest20603-21wc09:36:030
10259991510,3cyclictest0-21swapper/009:50:100
39352140,3sleep011-21rcuc/009:19:590
288872140,2sleep00-21swapper/010:19:450
1026299141,11cyclictest26201-21rm11:58:083
10262991410,2cyclictest17173-21if_eth007:25:153
1026299140,3cyclictest6403-21ssh09:21:133
1026299140,2cyclictest0-21swapper/310:58:343
1026299140,13cyclictest0-21swapper/310:35:173
1026299140,12cyclictest9156-21apt-get09:25:113
1026299140,12cyclictest0-21swapper/312:15:123
1026299140,12cyclictest0-21swapper/311:07:123
1026299140,12cyclictest0-21swapper/311:07:113
1026299140,12cyclictest0-21swapper/310:08:013
1026199140,7cyclictest1831250apt-get07:30:082
1026199140,7cyclictest1831250apt-get07:30:072
1026199140,2cyclictest0-21swapper/208:06:062
1026199140,12cyclictest0-21swapper/207:55:282
10260991411,2cyclictest9956-21kworker/u8:007:10:021
10260991411,2cyclictest29573-21kworker/u8:211:35:051
10260991411,2cyclictest14087-21kworker/u8:207:19:041
1026099140,2cyclictest0-21swapper/112:08:051
1025999149,3cyclictest9148-21sh09:25:100
1025999149,3cyclictest22671-21date11:55:000
1025999142,7cyclictest0-21swapper/009:01:580
1025999142,7cyclictest0-21swapper/008:39:580
10259991411,2cyclictest26610-21diskmemload10:08:590
10259991411,2cyclictest1100-21ssh11:31:190
1025999141,11cyclictest16883-21iostat_ios10:40:160
10259991410,2cyclictest20990-21sed12:26:010
10259991410,2cyclictest0-21swapper/007:15:000
1025999140,6cyclictest0-21swapper/009:13:020
1025999140,12cyclictest0-21swapper/012:30:260
1025999140,12cyclictest0-21swapper/011:56:350
16102130,2sleep026610-21diskmemload10:58:500
14012130,2sleep00-21swapper/012:05:560
10262991310,2cyclictest0-21swapper/312:05:223
10262991310,2cyclictest0-21swapper/311:54:453
10262991310,2cyclictest0-21swapper/311:42:163
10262991310,2cyclictest0-21swapper/311:35:253
10262991310,2cyclictest0-21swapper/311:15:143
10262991310,2cyclictest0-21swapper/311:14:223
10262991310,2cyclictest0-21swapper/310:00:433
10262991310,2cyclictest0-21swapper/309:51:183
10262991310,2cyclictest0-21swapper/309:35:433
10262991310,2cyclictest0-21swapper/309:11:533
1026299130,2cyclictest26610-21diskmemload11:23:543
1026299130,2cyclictest0-21swapper/309:15:063
1026299130,2cyclictest0-21swapper/307:50:113
1026299130,12cyclictest0-21swapper/312:30:153
1026299130,12cyclictest0-21swapper/311:31:013
1026299130,12cyclictest0-21swapper/310:49:133
1026299130,12cyclictest0-21swapper/310:20:123
1026299130,12cyclictest0-21swapper/309:45:163
1026299130,12cyclictest0-21swapper/308:25:013
1026299130,11cyclictest26610-21diskmemload09:31:383
1026199133,8cyclictest24904-21cut09:05:112
1026199133,8cyclictest12842-21cut08:35:132
1026199131,10cyclictest7454-21grep08:20:142
1026199131,10cyclictest3728-21runrttasks07:45:062
1026199131,10cyclictest2542-21cut08:10:132
1026199131,10cyclictest24066-21grep07:41:022
1026199131,10cyclictest22810-21munin-node2
1026199131,10cyclictest21485-21sed07:35:172
1026199131,10cyclictest21485-21sed07:35:162
1026199131,10cyclictest19725-21grep08:50:192
1026199131,10cyclictest11975-21taskset07:11:232
1026199131,10cyclictest0-21swapper/208:30:112
10261991310,2cyclictest0-21swapper/208:25:122
10261991310,2cyclictest0-21swapper/207:20:512
1026199130,2cyclictest0-21swapper/207:50:122
10260991310,2cyclictest17820-21kworker/u8:308:46:011
10260991310,2cyclictest16413-21kworker/u8:109:00:041
10260991310,2cyclictest0-21swapper/112:20:111
1026099130,2cyclictest0-21swapper/109:38:041
1026099130,2cyclictest0-21swapper/108:54:051
1026099130,2cyclictest0-21swapper/108:34:051
1026099130,2cyclictest0-21swapper/107:22:051
10259991310,2cyclictest8682-21kworker/u8:311:45:040
10259991310,2cyclictest0-21swapper/011:10:140
10259991310,2cyclictest0-21swapper/009:40:110
10259991310,2cyclictest0-21swapper/008:05:210
10259991310,2cyclictest0-21swapper/007:55:110
1025999130,4cyclictest0-21swapper/008:21:590
1025999130,2cyclictest3850-21apt-get09:20:050
1025999130,12cyclictest26610-21diskmemload09:55:100
1025999130,12cyclictest0-21swapper/012:23:290
1025999130,12cyclictest0-21swapper/012:02:000
1025999130,12cyclictest0-21swapper/010:35:520
1025999130,12cyclictest0-21swapper/010:23:500
1025999130,11cyclictest0-21swapper/011:36:060
1026299129,2cyclictest0-21swapper/312:25:103
1026299129,2cyclictest0-21swapper/312:10:253
1026299128,3cyclictest0-21swapper/311:25:473
1026299120,11cyclictest0-21swapper/312:22:153
1026299120,11cyclictest0-21swapper/310:40:233
1026299120,11cyclictest0-21swapper/309:55:243
1026299120,11cyclictest0-21swapper/308:10:013
1026199121,9cyclictest3728-21runrttasks08:15:102
1026099128,2cyclictest0-21swapper/109:10:111
1026099121,9cyclictest0-21swapper/108:11:041
1026099121,3cyclictest0-21swapper/110:45:141
1026099121,3cyclictest0-21swapper/108:05:151
1026099120,2cyclictest0-21swapper/109:44:051
1026099120,11cyclictest0-21swapper/107:25:291
1025999129,2cyclictest2727-21apt-get11:00:120
1025999129,2cyclictest2727-21apt-get11:00:110
1025999129,2cyclictest0-21swapper/012:10:560
1025999129,2cyclictest0-21swapper/011:40:090
1025999120,7cyclictest0-21swapper/008:53:010
1025999120,2cyclictest0-21swapper/012:17:050
1025999120,2cyclictest0-21swapper/011:15:130
1025999120,2cyclictest0-21swapper/009:05:130
1025999120,2cyclictest0-21swapper/007:40:150
1025999120,11cyclictest0-21swapper/012:35:160
1025999120,11cyclictest0-21swapper/011:05:150
1025999120,11cyclictest0-21swapper/011:05:140
1025999120,11cyclictest0-21swapper/010:53:010
1025999120,11cyclictest0-21swapper/010:45:120
1025999120,11cyclictest0-21swapper/010:25:150
1025999120,11cyclictest0-21swapper/009:45:200
1025999120,11cyclictest0-21swapper/008:25:110
1025999120,10cyclictest0-21swapper/011:26:060
1026299112,7cyclictest0-21swapper/308:17:593
1026299111,6cyclictest0-21swapper/308:59:593
1025999118,2cyclictest0-21swapper/010:30:400
1025999118,2cyclictest0-21swapper/007:46:040
1025999118,2cyclictest0-21swapper/007:35:190
1025999118,2cyclictest0-21swapper/007:35:180
1025999113,6cyclictest0-21swapper/007:53:260
1025999110,2cyclictest26610-21diskmemload10:03:300
1026299107,2cyclictest0-21swapper/308:41:193
1026299105,3cyclictest10762-21tr07:10:133
1026299102,7cyclictest0-21swapper/308:33:013
1026299101,5cyclictest0-21swapper/308:35:123
1026299100,7cyclictest4562-21gdm-simple-gree08:23:583
1025999107,2cyclictest0-21swapper/008:46:030
102629996,2cyclictest0-21swapper/308:00:303
102629996,2cyclictest0-21swapper/307:55:023
102629996,2cyclictest0-21swapper/307:40:123
102629994,3cyclictest23383-21tr09:00:153
102629994,3cyclictest22079-21sed07:36:033
102629994,3cyclictest22079-21sed07:36:023
102629994,3cyclictest18767-21cpu07:30:133
102629994,3cyclictest18767-21cpu07:30:133
102629991,5cyclictest0-21swapper/308:05:133
102599994,3cyclictest5007-21sed08:15:130
102599994,3cyclictest32110-21switchtime08:01:020
102629983,3cyclictest19022-21cpuspeed_turbos08:50:133
102629983,3cyclictest17019-21cpuspeed_turbos08:45:123
102629982,4cyclictest274-21jbd2/sda1-807:45:143
102599983,3cyclictest20933-21cut08:55:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional