You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 05:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1.osadl.org (updated Fri May 09, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1861021830,2sleep42040599cyclictest22:07:174
3198021640,1sleep331977-21chk_conn_tcp20:52:413
3153821590,2sleep22040099cyclictest00:20:402
2905421580,2sleep62040999cyclictest23:54:086
2934021510,1sleep10-21swapper/122:37:271
1421821510,3sleep22040099cyclictest19:51:022
1823921500,2sleep42040599cyclictest20:28:144
3106721480,2sleep02039399cyclictest22:12:180
595621470,3sleep42040599cyclictest21:23:424
595621470,3sleep42040599cyclictest21:23:424
2828421370,3sleep62040999cyclictest21:58:306
65521360,2sleep62040999cyclictest20:01:156
1703321360,0sleep20-21swapper/220:09:212
1178521350,2sleep22040099cyclictest20:41:342
2740621330,1sleep227398-21chk_conn_tcp19:23:462
2442521320,3sleep42040599cyclictest20:48:414
1310121320,1sleep416165-21chk_conn_tcp00:00:554
204089913129,54cyclictest0-21swapper/522:25:585
1631821300,0sleep70-21swapper/723:36:307
123321270,1sleep12039699cyclictest20:35:561
959321260,0sleep00-21swapper/021:38:050
2766621260,0sleep60-21swapper/622:49:026
20400991252,33cyclictest30859-21G107:43:152
204089912129,1cyclictest16495-21chk_conn_tcp19:43:305
204089912129,1cyclictest16495-21chk_conn_tcp19:43:305
204109912011,54cyclictest3730-21watchprog-ntop23:26:537
20393991200,38cyclictest188850irq/25-eth000:01:370
1368221200,0sleep10-21swapper/122:04:501
204109911371,23cyclictest5454-21chk_conn_tcp20:20:557
204089911334,58cyclictest61-21ksoftirqd/521:36:165
944821120,0sleep50-21swapper/523:46:465
20404991121,59cyclictest7673-21chk_conn_tcp20:56:433
1533921120,1sleep314342-21chk_conn_tcp21:13:563
40821110,1sleep314342-21chk_conn_tcp22:25:353
204109911118,0cyclictest0-21swapper/700:32:377
204089911116,0cyclictest0-21swapper/523:33:185
204009911127,40cyclictest0-21swapper/200:12:512
204089911011,2cyclictest11672-21ssh22:17:255
2532221090,1sleep525318-21chk_conn_tcp19:23:095
204109910727,39cyclictest3770-21chk_conn_tcp21:22:547
204109910618,16cyclictest3730-21watchprog-ntop23:04:587
204049910614,59cyclictest27157-21openvpn00:13:553
204049910523,77cyclictest3730-21watchprog-ntop23:12:593
20410991047,38cyclictest16495-21chk_conn_tcp21:56:027
204109910433,1cyclictest0-21swapper/720:13:587
204109910234,26cyclictest14342-21chk_conn_tcp22:37:117
204049910229,60cyclictest19694-21diskmemload23:02:183
204109910135,55cyclictest0-21swapper/722:57:307
204109910129,21cyclictest11-21rcu_preempt23:52:007
204089910116,37cyclictest3730-21watchprog-ntop20:55:395
20404991010,37cyclictest0-21swapper/322:20:373
204089910044,13cyclictest0-21swapper/520:17:425
20408999942,39cyclictest0-21swapper/522:47:525
20400999940,21cyclictest2448-21openvpn20:20:232
20410999847,50cyclictest0-21swapper/721:25:027
20410999847,50cyclictest0-21swapper/721:25:027
20410999737,6cyclictest3730-21watchprog-ntop22:51:377
20408999733,23cyclictest3730-21watchprog-ntop22:40:235
20404999718,37cyclictest0-21swapper/319:56:523
20396999726,57cyclictest0-21swapper/123:36:301
2039399979,29cyclictest3730-21watchprog-ntop20:22:310
20410999640,35cyclictest0-21swapper/719:44:027
20404999635,38cyclictest27157-21openvpn00:21:243
20404999616,21cyclictest3730-21watchprog-ntop23:30:383
20404999529,60cyclictest0-21swapper/323:52:323
20396999516,9cyclictest29471-21G107:43:151
20396999515,53cyclictest0-21swapper/123:44:311
20396999514,41cyclictest3730-21watchprog-ntop21:27:111
20396999514,41cyclictest3730-21watchprog-ntop21:27:111
20396999510,44cyclictest3730-21watchprog-ntop00:23:321
20410999412,32cyclictest3730-21watchprog-ntop00:08:347
2041099940,22cyclictest0-21swapper/721:33:037
20408999412,25cyclictest0-21swapper/521:17:335
20410999321,12cyclictest0-21swapper/720:26:157
2040499935,61cyclictest0-21swapper/323:39:433
20400999312,51cyclictest0-21swapper/222:44:402
20396999330,7cyclictest0-21swapper/123:41:511
20404999222,14cyclictest0-21swapper/322:44:083
20396999130,36cyclictest0-21swapper/121:38:241
20396999129,47cyclictest3730-21watchprog-ntop23:15:401
20396999126,20cyclictest0-21swapper/100:19:471
2041099907,25cyclictest0-21swapper/719:10:227
20404999055,17cyclictest3730-21watchprog-ntop19:11:273
20404999016,19cyclictest3730-21watchprog-ntop19:39:143
20404999016,19cyclictest3730-21watchprog-ntop19:39:143
20404999015,37cyclictest27157-21openvpn19:34:573
20404999015,37cyclictest27157-21openvpn19:34:573
20410998939,24cyclictest0-21swapper/720:36:257
2040499893,21cyclictest2448-21openvpn20:44:583
20396998957,31cyclictest3730-21watchprog-ntop22:25:261
20396998914,22cyclictest27157-21openvpn21:53:541
20408998850,20cyclictest16165-21chk_conn_tcp23:01:145
2040499889,49cyclictest0-21swapper/300:13:233
20396998828,0cyclictest3730-21watchprog-ntop21:19:101
20396998815,23cyclictest0-21swapper/122:56:251
20396998814,0cyclictest0-21swapper/119:09:181
20393998829,39cyclictest0-21swapper/020:28:240
20408998729,35cyclictest0-21swapper/521:10:375
20408998727,0cyclictest0-21swapper/523:54:405
2040499876,39cyclictest0-21swapper/321:43:133
20404998730,42cyclictest3730-21watchprog-ntop21:31:273
20404998727,39cyclictest3730-21watchprog-ntop22:00:513
20400998714,19cyclictest0-21swapper/222:50:012
20396998711,20cyclictest0-21swapper/120:30:001
20396998711,20cyclictest0-21swapper/120:30:001
282792860,0sleep40-21swapper/400:19:064
20410998625,23cyclictest3730-21watchprog-ntop19:28:017
20404998671,14cyclictest14342-21chk_conn_tcp00:30:293
20404998670,11cyclictest3730-21watchprog-ntop21:11:093
20404998622,30cyclictest0-21swapper/322:12:363
2039699868,61cyclictest30220-21chk_conn_tcp19:42:581
2039699868,61cyclictest30220-21chk_conn_tcp19:42:581
20396998654,19cyclictest14342-21chk_conn_tcp21:46:251
2041099855,58cyclictest0-21swapper/723:45:037
2040499851,43cyclictest16165-21chk_conn_tcp23:16:443
20396998519,52cyclictest0-21swapper/119:19:271
20396998512,6cyclictest0-21swapper/123:27:251
20410998447,1cyclictest16165-21chk_conn_tcp20:13:267
20410998321,2cyclictest0-21swapper/719:59:327
20408998317,1cyclictest0-21swapper/521:20:465
2040499838,27cyclictest0-21swapper/323:27:573
20404998314,21cyclictest0-21swapper/322:14:443
20396998336,29cyclictest27157-21openvpn20:14:301
20396998319,45cyclictest0-21swapper/122:59:061
20396998312,51cyclictest214750irq/32-eth2-TxR21:00:591
20410998218,22cyclictest0-21swapper/723:56:177
20408998218,35cyclictest0-21swapper/520:00:365
20408998218,24cyclictest18523-21munin-node21:28:475
20400998241,17cyclictest3730-21watchprog-ntop21:15:572
20400998227,24cyclictest31309-21chk_conn_tcp23:55:122
20396998221,53cyclictest3730-21watchprog-ntop22:53:131
20410998135,37cyclictest0-21swapper/700:20:527
20410998117,31cyclictest0-21swapper/722:22:457
20404998128,25cyclictest0-21swapper/300:01:053
2041099806,40cyclictest0-21swapper/719:31:137
20410998040,21cyclictest16495-21chk_conn_tcp19:36:347
20410998040,21cyclictest16495-21chk_conn_tcp19:36:347
20408998040,19cyclictest16495-21chk_conn_tcp20:32:085
20408998040,19cyclictest16495-21chk_conn_tcp20:32:085
2040899802,1cyclictest0-21swapper/523:37:025
2040899801,47cyclictest0-21swapper/522:05:075
2040099804,38cyclictest0-21swapper/223:38:062
20396998014,58cyclictest27157-21openvpn19:23:441
20410997918,40cyclictest0-21swapper/720:47:067
20408997924,40cyclictest0-21swapper/523:22:045
20404997918,34cyclictest4673-21chk_conn_tcp22:48:563
20400997936,23cyclictest0-21swapper/220:57:472
20408997816,61cyclictest4673-21chk_conn_tcp22:08:525
2040099783,38cyclictest3730-21watchprog-ntop23:05:302
20400997811,6cyclictest0-21swapper/221:50:092
2039699782,67cyclictest3730-21watchprog-ntop00:28:531
131382780,20sleep7214550irq/30-eth2-TxR21:38:527
20408997728,0cyclictest0-21swapper/519:30:415
2040499775,36cyclictest1548-21chk_conn_tcp21:21:503
2040099775,49cyclictest0-21swapper/222:32:222
20400997714,7cyclictest0-21swapper/221:07:242
20393997733,43cyclictest3730-21watchprog-ntop20:08:370
254752760,0sleep60-21swapper/600:05:546
2040899760,7cyclictest3730-21watchprog-ntop19:54:125
20400997614,1cyclictest0-21swapper/219:17:512
20396997615,19cyclictest0-21swapper/120:10:131
2039399761,46cyclictest188850irq/25-eth021:23:580
2039399761,46cyclictest188850irq/25-eth021:23:580
69212750,0sleep40-21swapper/423:45:334
261192750,1sleep125-21ksoftirqd/100:06:131
20408997516,25cyclictest0-21swapper/521:03:085
2040499757,15cyclictest512-21nping19:26:563
20400997510,19cyclictest0-21swapper/220:37:292
20393997523,20cyclictest0-21swapper/023:45:350
2040899747,26cyclictest0-21swapper/521:05:165
20408997438,18cyclictest3730-21watchprog-ntop22:28:385
20408997414,20cyclictest0-21swapper/520:06:295
20396997414,20cyclictest0-21swapper/123:53:041
20400997333,18cyclictest0-21swapper/222:23:172
20400997325,0cyclictest0-21swapper/219:20:002
2039699737,31cyclictest0-21swapper/100:14:271
147292730,0sleep50-21swapper/519:33:505
147292730,0sleep50-21swapper/519:33:505
2040899725,26cyclictest3730-21watchprog-ntop20:39:055
2040099721,48cyclictest0-21swapper/219:08:142
301362710,0sleep40-21swapper/421:07:324
20410997128,5cyclictest3730-21watchprog-ntop19:53:407
20408997127,29cyclictest0-21swapper/500:22:285
20400997111,42cyclictest0-21swapper/222:10:282
20396997115,28cyclictest0-21swapper/123:12:271
20396997114,13cyclictest20299-21ssh21:42:081
20393997131,32cyclictest29039-21chk_conn_tcp21:45:210
20393997113,22cyclictest14342-21chk_conn_tcp21:29:510
38582700,0sleep40-21swapper/400:10:014
249782700,0sleep60-21swapper/622:35:166
207272700,2sleep47236-21kworker/4:119:19:474
2040899709,43cyclictest3730-21watchprog-ntop00:26:125
175152700,0sleep40-21swapper/422:45:074
62462690,1sleep43729-21runrttasks23:06:474
237412690,0sleep70-21swapper/719:38:497
237412690,0sleep70-21swapper/719:38:497
2040899693,44cyclictest27157-21openvpn19:48:515
20408996924,22cyclictest0-21swapper/522:35:355
2040499697,40cyclictest0-21swapper/320:58:513
2040499693,35cyclictest0-21swapper/320:04:533
20400996930,0cyclictest0-21swapper/221:54:262
20396996932,16cyclictest27157-21openvpn23:58:571
117362690,1sleep670-21ksoftirqd/620:58:446
23402680,0sleep50-21swapper/519:28:135
2041099685,18cyclictest3730-21watchprog-ntop23:18:527
2040899689,14cyclictest3730-21watchprog-ntop19:04:305
2040899688,0cyclictest0-21swapper/520:43:535
20404996814,26cyclictest0-21swapper/323:53:363
20404996810,30cyclictest0-21swapper/319:49:553
2040099689,35cyclictest0-21swapper/220:33:122
2040099689,35cyclictest0-21swapper/220:33:122
2040099687,39cyclictest214850irq/33-eth2-TxR23:49:522
2040099686,8cyclictest3730-21watchprog-ntop22:23:492
20400996830,0cyclictest0-21swapper/221:41:362
20400996827,0cyclictest0-21swapper/223:40:472
20400996813,19cyclictest0-21swapper/220:08:052
2040099680,28cyclictest0-21swapper/222:56:572
2039699685,19cyclictest2259-21rs:main1
20396996810,17cyclictest0-21swapper/122:45:441
167112680,0sleep70-21swapper/700:02:427
69562670,0sleep70-21swapper/722:41:107
52412670,0sleep20-21swapper/221:35:582
2041099679,35cyclictest0-21swapper/720:56:117
20396996732,19cyclictest5787-21chk_conn_tcp21:30:231
20393996728,16cyclictest0-21swapper/021:00:270
2039399671,24cyclictest0-21swapper/021:50:410
20393996712,39cyclictest563-21jbd2/md0-821:07:560
174702670,1sleep668-21rcuc/600:03:056
126432670,1sleep341-21rcuc/320:24:123
94062660,0sleep00-21swapper/023:08:190
2040499661,54cyclictest0-21swapper/322:06:433
20400996610,0cyclictest0-21swapper/220:59:232
20393996624,5cyclictest0-21swapper/000:31:330
17822660,1sleep61785-21fschecks_time23:43:426
68172650,0sleep10-21swapper/100:11:261
296202650,1sleep629614-21chk_conn_tcp22:11:366
2040899658,13cyclictest0-21swapper/521:42:405
2040899655,15cyclictest0-21swapper/520:23:035
20408996510,34cyclictest0-21swapper/519:11:595
2040499653,59cyclictest14342-21chk_conn_tcp19:22:083
20400996425,9cyclictest29486-21VM07:43:152
20400996410,37cyclictest0-21swapper/223:03:222
2039699640,3cyclictest0-21swapper/120:24:071
10132640,0sleep60-21swapper/623:04:166
53012630,1sleep670-21ksoftirqd/600:10:436
2041099635,13cyclictest0-21swapper/700:25:407
20410996314,26cyclictest0-21swapper/722:15:167
2041099630,40cyclictest0-21swapper/721:34:407
2040499631,20cyclictest0-21swapper/319:47:473
262472620,0sleep40-21swapper/420:14:204
20404996214,38cyclictest3730-21watchprog-ntop19:03:583
20400996241,20cyclictest3730-21watchprog-ntop22:33:592
20400996238,21cyclictest27157-21openvpn00:00:012
20400996223,1cyclictest0-21swapper/200:16:032
2040099620,26cyclictest0-21swapper/222:17:572
2040099620,13cyclictest3730-21watchprog-ntop23:25:172
2039699623,39cyclictest0-21swapper/119:28:331
20396996224,17cyclictest0-21swapper/120:05:571
205622610,2sleep02039399cyclictest23:25:010
20410996112,48cyclictest0-21swapper/720:49:147
20404996121,1cyclictest0-21swapper/323:43:593
78482600,0sleep60-21swapper/622:15:376
73932600,0sleep10-21swapper/122:15:231
67372600,1sleep04673-21chk_conn_tcp19:13:180
20408996017,1cyclictest0-21swapper/523:13:315
20408996015,20cyclictest0-21swapper/522:54:495
2040899600,19cyclictest12624-21chk_conn_tcp19:15:435
2040499601,24cyclictest0-21swapper/300:06:263
2040099603,0cyclictest0-21swapper/219:34:252
2040099603,0cyclictest0-21swapper/219:34:252
2040099600,58cyclictest0-21swapper/219:46:432
2039399600,46cyclictest0-21swapper/019:49:230
280142590,0sleep70-21swapper/719:07:087
214362590,1sleep614342-21chk_conn_tcp00:29:106
20410995922,20cyclictest3730-21watchprog-ntop23:41:197
20410995920,19cyclictest0-21swapper/719:52:357
87812580,0sleep668-21rcuc/623:20:276
75262580,0sleep00-21swapper/022:41:270
51532580,0sleep50-21swapper/523:06:165
2040899588,1cyclictest0-21swapper/520:34:165
20400995810,47cyclictest0-21swapper/223:10:192
20396995815,5cyclictest0-21swapper/119:05:341
109532580,0sleep00-21swapper/020:41:000
38792570,0sleep30-21swapper/320:19:473
20410995724,4cyclictest0-21swapper/721:48:337
20400995719,1cyclictest0-21swapper/222:02:272
2040099571,19cyclictest3730-21watchprog-ntop20:24:392
15092570,0sleep40-21swapper/422:26:084
62532560,3sleep62040999cyclictest20:21:276
258152560,1sleep123-21rcuc/122:23:171
20410995614,23cyclictest0-21swapper/722:01:237
20396995611,38cyclictest0-21swapper/122:09:561
20393995637,0cyclictest0-21swapper/022:20:050
20393995621,19cyclictest0-21swapper/000:18:110
27732550,3sleep12039699cyclictest23:57:081
20405995553,1cyclictest0-21swapper/423:50:244
2040499553,1cyclictest0-21swapper/323:19:563
2039699558,16cyclictest3730-21watchprog-ntop19:35:291
2039699558,16cyclictest3730-21watchprog-ntop19:35:291
2039699550,0cyclictest0-21swapper/119:48:191
20408995418,22cyclictest0-21swapper/519:45:075
20400995415,0cyclictest0-21swapper/221:48:012
20393995419,0cyclictest0-21swapper/021:41:040
10392540,0sleep60-21swapper/622:25:546
20404995324,2cyclictest0-21swapper/322:40:553
2040099530,0cyclictest0-21swapper/220:48:102
318392520,1sleep52040899cyclictest20:52:345
2040599520,1cyclictest0-21swapper/423:27:574
20400995222,28cyclictest0-21swapper/223:47:442
20393995213,38cyclictest0-21swapper/019:17:190
2039399520,1cyclictest0-21swapper/020:49:460
180202520,3sleep62040999cyclictest23:11:216
165852520,3sleep72041099cyclictest22:06:167
5712510,0sleep00-21swapper/022:25:400
320272510,0sleep50-21swapper/522:51:095
25182510,0sleep40-21swapper/421:34:404
2040599515,45cyclictest0-21swapper/423:14:044
2040099510,31cyclictest0-21swapper/221:18:382
2039399510,28cyclictest16495-21chk_conn_tcp23:30:050
95942500,0sleep60-21swapper/619:31:356
281292500,0sleep52040899cyclictest00:07:135
20404995015,29cyclictest0-21swapper/321:25:343
20404995015,29cyclictest0-21swapper/321:25:343
2040099507,1cyclictest0-21swapper/223:16:122
20400995016,12cyclictest0-21swapper/220:17:102
20393995046,3cyclictest188850irq/25-eth021:53:540
20393995035,1cyclictest3730-21watchprog-ntop19:29:370
20393995019,12cyclictest0-21swapper/019:21:040
20393995011,38cyclictest5787-21chk_conn_tcp00:26:440
16842500,0sleep00-21swapper/023:18:120
9042490,0sleep30-21swapper/320:35:423
76552490,0sleep40-21swapper/422:53:574
7442490,0sleep60-21swapper/619:09:076
20405994947,1cyclictest2448-21openvpn20:55:394
20404994918,17cyclictest0-21swapper/321:46:573
20393994920,18cyclictest0-21swapper/020:47:380
2040599485,42cyclictest0-21swapper/420:28:564
2040599485,42cyclictest0-21swapper/420:28:564
20405994846,1cyclictest8243-21chk_conn_tcp22:15:484
2040099486,22cyclictest0-21swapper/219:38:422
2040099486,22cyclictest0-21swapper/219:38:422
141622480,3sleep42040599cyclictest20:59:314
278472470,21sleep1214750irq/32-eth2-TxR21:06:251
20408994728,18cyclictest0-21swapper/522:00:195
20405994745,1cyclictest0-21swapper/400:17:074
20393994731,1cyclictest188850irq/25-eth020:15:020
236082460,0sleep20-21swapper/219:56:072
20409994637,8cyclictest0-21swapper/619:07:426
20409994631,1cyclictest16165-21chk_conn_tcp00:25:086
1739424619,7sleep50-21swapper/519:01:545
2040599455,39cyclictest0-21swapper/421:22:544
2040599451,43cyclictest0-21swapper/422:29:424
20393994543,1cyclictest188850irq/25-eth000:21:240
2039399454,22cyclictest0-21swapper/021:09:000
111092450,0sleep60-21swapper/620:41:066
109332450,0sleep40-21swapper/419:32:294
11452440,0sleep10-21swapper/120:53:351
2040599430,42cyclictest23900-21chk_conn_tcp21:30:234
2040499435,20cyclictest0-21swapper/322:36:393
20393994341,1cyclictest188850irq/25-eth023:50:240
20409994227,1cyclictest27157-21openvpn22:53:456
20405994240,1cyclictest31640-21chk_conn_tcp19:08:464
2040599421,40cyclictest0-21swapper/422:00:514
2040599421,1cyclictest6484-21chk_conn_tcp21:10:374
2040599420,1cyclictest0-21swapper/421:48:014
2040899410,3cyclictest0-21swapper/500:15:315
2040599414,36cyclictest0-21swapper/423:11:234
20404994122,3cyclictest0-21swapper/320:40:093
20393994139,1cyclictest188850irq/25-eth023:12:270
20393994124,16cyclictest4673-21chk_conn_tcp22:02:590
2040599404,1cyclictest52-21ksoftirqd/400:03:464
1507324018,7sleep40-21swapper/419:00:174
20409993913,20cyclictest0-21swapper/619:16:156
20405993937,1cyclictest2690-21watchprog-ntop20:36:574
20393993937,1cyclictest188850irq/25-eth020:28:560
20393993937,1cyclictest188850irq/25-eth020:28:560
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional