. Reconstruction and . .. Stability-for-semi-supervised-learning,

. .. Hybridnet-framework,

. .. Experiments, 59 3.4 .1 Datasets and data processing

.. .. Conclusion,

, Contents

. .. Dualdis-approach, , vol.88

.. .. Discussion,

.. .. Semi-supervised-learning,

, 7 .2 Image generation for Data Augmentation

.. .. Conclusion,

A. Achille and S. Soatto, Information Dropout: learning optimal representations through noisy computation, vol.32, p.23, 2016.

G. Alain and Y. Bengio, What regularized auto-encoders learn from the data-generating distribution, Journal of Machine Learning Research, p.25, 2014.

A. Alemi, Improving Inception and Image Classification in TensorFlow, p.17, 2016.

A. Alemi, I. Fischer, J. V. Dillon, and K. Murphy, Deep Variational Information Bottleneck, International Conference on Learning Representations (ICLR) (cit, vol.32, p.23, 2017.

G. An, The effects of adding noise during backpropagation training on a generalization performance, Neural computation (cit, p.20, 1996.

D. Bang and H. Shim, Mggan: Solving mode collapse using manifold guided training, p.82, 2018.

. Ben-david, J. Shai, K. Blitzer, A. Crammer, F. Kulesza et al., A theory of learning from different domains, Machine learning, p.106, 2010.

Y. Bengio, A. Courville, and P. Vincent, Representation Learning: A Review and New Perspectives, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.35, issue.8, pp.1798-1828, 2013.

Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, Greedy Layer-Wise Training of Deep Networks, Advances in Neural Information Processing Systems 19, vol.45, p.23, 2007.

H. Ben-younes, R. Cadene, M. Cord, and N. Thome, MUTAN: Multimodal Tucker Fusion for Visual Question Answering, 2017 IEEE International Conference on Computer Vision (ICCV), 2017.
URL : https://hal.archives-ouvertes.fr/hal-02073637

Y. Blau and T. Michaeli, The Perception-Distortion Tradeoff, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, p.81, 2018.

M. Blot, Study on training methods and generalization performance of deep learning for image classification, vol.13, p.11, 2018.
URL : https://hal.archives-ouvertes.fr/tel-02862841

M. Blot, T. Robert, N. Thome, and M. Cord, Shade: Information-Based Regularization for Deep Learning, 2018 25th IEEE International Conference on Image Processing (ICIP), p.31, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01994740

M. Blot, T. Robert, N. Thome, and M. Cord, Shade: Information-Based Regularization for Deep Learning, 2018 25th IEEE International Conference on Image Processing (ICIP), vol.11, p.9, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01994740

A. Blum and T. Mitchell, Combining labeled and unlabeled data with co-training, Proceedings of the eleventh annual conference on Computational learning theory - COLT' 98, p.24, 1998.

N. Bodla, G. Hua, and R. Chellappa, Semi-supervised FusedGAN for Conditional Image Generation, Computer Vision ? ECCV 2018, vol.82, pp.689-704, 2018.

L. Bottou, Large-Scale Machine Learning with Stochastic Gradient Descent, Proceedings of COMPSTAT'2010, pp.177-186, 2010.

K. Bousmalis, N. Silberman, D. Dohan, D. Erhan, and D. Krishnan, Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), p.107, 2017.

A. Brock, J. Donahue, and K. Simonyan, Large scale gan training for high fidelity natural image synthesis, International Conference on Learning Representations (ICLR) (cit, p.82, 2019.

J. Bruna and S. Mallat, Invariant Scattering Convolution Networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.35, issue.8, pp.1872-1886, 2013.

M. Carvalho, R. Cadène, D. Picard, L. Soulier, N. Thome et al., Cross-Modal Retrieval in the Cooking Context, The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, p.44, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01839068

W. Chang, H. Wang, W. Peng, and W. Chiu, All About Structure: Adapting Structural Information Across Domains for Boosting Semantic Segmentation, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), vol.107, p.77, 2019.

L. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.40, issue.4, pp.834-848, 2018.

T. Chen, X. Qi, . Li, B. Roger, D. K. Grosse et al., A Variational Approach to Learning Curves, Advances in Neural Information Processing Systems 14, 2002.

X. Chen, Y. Duan, R. Houthooft, J. Schulman, I. Sutskever et al., InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets, Advances in Neural Information Processing Systems (NIPS) (cit, p.129, 2016.

B. Cheung, J. A. Livezey, K. Arjun, B. A. Bansal, and . Olshausen, Discovering hidden factors of variation in deep networks, International Conference on Machine Learning Workshop (ICML-W) (cit. on p, p.27, 2015.

Y. Choi, M. Choi, M. Kim, J. Ha, S. Kim et al., StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, p.81, 2018.

D. Ciresan, U. Meier, and J. Schmidhuber, Multi-column deep neural networks for image classification, 2012 IEEE Conference on Computer Vision and Pattern Recognition, p.20, 2012.

A. Coates, B. Carpenter, C. Case, S. Satheesh, B. Suresh et al., Text Detection and Character Recognition in Scene Images with Unsupervised Feature Learning, 2011 International Conference on Document Analysis and Recognition, p.60, 2011.

T. Cohen and M. Welling, Group equivariant convolutional networks, International Conference on Machine Learning (ICML), 2016.

T. M. Cover and J. A. Thomas, Elements of Information Theory, 1991.

J. Dai, Y. Li, K. He, and J. Sun, R-FCN: Object detection via region-based fully convolutional networks, Advances in Neural Information Processing Systems (NIPS) (cit, p.44, 2016.

E. Denton, S. Gross, and R. Fergus, Semi-Supervised Learning with Context-Conditional Generative Adversarial Networks, International Conference on Learning Representations (ICLR, 2017.

T. Devries and G. W. Taylor, Dataset augmentation in feature space, International Conference on Learning Representations Workshop (ICLR-W) (cit, p.20, 2017.

S. Dieleman, K. W. Willett, and J. Dambre, Rotation-invariant convolutional neural networks for galaxy morphology prediction, Monthly Notices of the Royal Astronomical Society, vol.450, issue.2, pp.1441-1459, 2015.

J. Donahue, P. Krähenbühl, and T. Darrell, Adversarial Feature Learning, International Conference on Learning Representations (ICLR) (cit, p.82, 2017.

A. Dosovitskiy and T. Brox, Combining casual and similarity-based reasoning, Advances in Neural Information Processing Systems 19, vol.87, 2007.

J. Duchi, E. Hazan, and Y. Singer, Incremental Gradient, Subgradient, and Proximal Methods for Convex Optimization: A Survey, Optimization for Machine Learning, p.15, 2011.

V. Dumoulin, I. Belghazi, B. Poole, A. Lamb, M. Arjovsky et al., Adversarially Learned Inference, International Conference on Learning Representations (ICLR) (cit, p.82, 2017.

V. Dumoulin and F. Visin, Deep Learning Convolutional Neural Network, Deep Learning Neural Networks, pp.41-55, 2016.

E. Dupont, Neural Information Processing Systems, The Deep Learning Revolution, p.83, 2018.

T. Durand, Deep Architectures in LaTeX, p.16, 2017.

T. Durand, N. Mehrasa, and G. Mori, Learning a Deep ConvNet for Multi-Label Classification With Partial Labels, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), p.24, 2019.

T. Durand, N. Thome, and M. Cord, WELDON: Weakly Supervised Learning of Deep Convolutional Neural Networks, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol.38, p.37, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01343785

D. A. Dyk, X. Van, and . Meng, The Art of Data Augmentation, Journal of Computational and Graphical Statistics, 2001.

J. Engel, M. Hoffman, and A. Roberts, Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models, International Conference on Learning Representations (ICLR) (cit. on pp, vol.83, p.82, 2018.

M. Engilberge, L. Chevallier, P. Perez, and M. Cord, Finding Beans in Burgers: Deep Semantic-Visual Embedding with Localization, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, p.44, 2018.
URL : https://hal.archives-ouvertes.fr/hal-02171857

D. Erhan, Y. Bengio, A. Courville, P. Manzagol, P. Vincent et al., Why does unsupervised pre-training help deep learning?, In: Journal of Machine Learning Research, p.23, 2010.

K. Fukushima, Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position, Biological Cybernetics, vol.36, issue.4, pp.193-202, 1980.

Y. Ganin and V. Lempitsky, Unsupervised Domain Adaptation by Backpropagation, International Conference on Machine Learning (ICML), p.38, 2015.

Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle et al., Domain-Adversarial Training of Neural Networks, Domain Adaptation in Computer Vision Applications, pp.189-209, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01624607

X. Gastaldi, Shake-Shake regularization of 3-branch residual networks, International Conference on Learning Representations Workshop (ICLR-W), 2017.

A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, From few to many: illumination cone models for face recognition under variable lighting and pose, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.23, issue.6, pp.643-660, 2001.

G. Ghiasi, T. Lin, and Q. Le, DropBlock: A regularization method for convolutional networks, Advances in Neural Information Processing Systems (NeurIPS) (cit, p.21, 2018.

X. Glorot, A. Bordes, and Y. Bengio, Deep sparse rectifier neural networks, International Conference on Artificial Intelligence and Statistics (AISTATS) (cit, p.25, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00752497

H. Goh, N. Thome, M. Cord, and J. Lim, Topdown regularization of deep belief networks, Advances in Neural Information Processing Systems (NIPS) (cit, p.25, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00947569

A. N. Gomez, M. Ren, R. Urtasun, and R. Grosse, Backpropagation, Neural Network Learning and Expert Systems, vol.108, p.51, 1993.

I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning, vol.21, p.19, 2016.

I. Goodfellow, J. Pouget-abadie, M. Mirza, B. Xu, D. Warde-farley et al., Generative Adversarial Nets, Advances in Neural Information Processing Systems (NIPS) (cit. on pp. 9, vol.25, p.81, 2014.

I. Goodfellow, J. Shlens, and C. Szegedy, Explaining and harnessing adversarial examples, International Conference on Learning Representations (ICLR) (cit. on pp, vol.26, p.20, 2015.

Y. Grandvalet and Y. Bengio, Semi-supervised learning by entropy minimization, Advances in neural information processing systems, p.24, 2005.

Y. Grandvalet, S. Canu, and S. Boucheron, Noise Injection: Theoretical Prospects, Neural Computation, vol.9, issue.5, pp.1093-1108, 1997.

N. Hadad, L. Wolf, and M. Shahar, A Two-Step Disentanglement Method, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, vol.86, p.91, 2018.

J. Hale and . Loke, Figure .5.21..YouTube: national and international viewing of domestically uploaded content

K. He, X. Zhang, S. Ren, and J. Sun, Deep Residual Learning for Image Recognition, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol.4, p.37, 2016.

Z. He, W. Zuo, M. Kan, S. Shan, and X. Chen, AttGAN: Facial Attribute Editing by Only Changing What You Want, IEEE Transactions on Image Processing, vol.28, issue.11, pp.5464-5478, 2019.

I. Higgins, D. Amos, D. Pfau, S. Racaniere, L. Matthey et al., Pfau, David III, 2011.

I. Higgins, L. Matthey, A. Pal, C. Burgess, X. Glorot et al., Higgins, Matthew James (1810?1868), International Conference on Learning Representations (ICLR, 2017.

G. Hinton and R. Salakhutdinov, Reducing the Dimensionality of Data with Neural Networks, Science, vol.313, issue.5786, pp.504-507, 2006.

G. Hinton, N. Srivastava, and K. Swersky, Neural networks for machine learning lecture 6a overview of mini-batch gradient descent (cit, p.15, 2012.

Q. Hu, A. Szabó, T. Portenier, P. Favaro, and M. Zwicker, Disentangling Factors of Variation by Mixing Them, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (cit, p.84, 2018.

D. H. Hubel and T. N. Wiesel, Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, The Journal of Physiology, vol.160, issue.1, pp.106-154, 1962.

S. Ioffe and C. Szegedy, Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, Journal of Machine Learning Research, 2016.

A. Iscen, G. Tolias, Y. Avrithis, and O. Chum, Label Propagation for Deep Semi-Supervised Learning, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), vol.97, p.24, 2019.
URL : https://hal.archives-ouvertes.fr/hal-02370297

J. Jacobsen, B. D. Brabandere, and A. Smeulders, Dynamic Steerable Blocks in Deep Residual Networks, Procedings of the British Machine Vision Conference 2017, vol.108, p.51, 2017.

A. Jaiswal and R. Y. Wu, Unsupervised Adversarial Invariance, Advances in Neural Information Processing Systems (NeurIPS) (cit. on pp, vol.27, p.91, 2018.

G. Kang, J. Li, and D. Tao, Shakeout: A New Approach to Regularized Deep Neural Network Training, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.40, issue.5, pp.1245-1258, 2018.

T. Karras, S. Laine, M. Aittala, J. Hellsten, J. Lehtinen et al., Analyzing and Improving the Image Quality of StyleGAN, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), p.81, 2020.

T. Karras, S. Laine, and T. Aila, A Style-Based Generator Architecture for Generative Adversarial Networks, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), vol.81, 2019.

K. Kawaguchi, Scaling laws and local minima in Hebbian ICA, Advances in Neural Information Processing Systems 14, 2002.

H. Kim and A. Mnih, Preprint repository arXiv achieves milestone million uploads, Physics Today, p.83, 2014.

D. P. Kingma and J. Ba, Adam: A method for stochastic optimization, International Conference on Learning Representations (ICLR) (cit, p.15, 2015.

D. P. Kingma and P. Dhariwal, Glow: Generative flow with invertible 1x1 convolutions, Advances in Neural Information Processing Systems (NeurIPS) (cit, p.109, 2018.

D. P. Kingma, S. Mohamed, D. Jimenez-rezende, and M. Welling, Semi-supervised learning with deep generative models, Advances in Neural Information Processing Systems (NIPS), 2014.

D. P. Kingma and M. Welling, An Introduction to Variational Autoencoders, International Conference on Learning Representations (ICLR) (cit. on pp. 25, vol.80, 2019.

J. Klys, J. Snell, and R. Zemel, A Variational Approach to Learning Curves, Advances in Neural Information Processing Systems 14, vol.86, p.91, 2002.

N. Kodali, J. Abernethy, J. Hays, and Z. Kira, Preprint repository arXiv achieves milestone million uploads, Physics Today, p.81, 2014.

I. Kokkinos, UberNet: Training a Universal Convolutional Neural Network for Low-, Mid-, and High-Level Vision Using Diverse Datasets and Limited Memory, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.

A. Krizhevsky and G. Hinton, Learning multiple layers of features from tiny images, vol.60, p.36, 2009.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, ImageNet classification with deep convolutional neural networks, Communications of the ACM, vol.60, issue.6, pp.84-90, 2017.

A. Krogh and J. A. Hertz, A Simple Weight Decay Can Improve Generalization, Advances in Neural Information Processing Systems (NIPS), 1992.

J. Kuka?ka, V. Golkov, and D. Cremers, Regularization for deep learning: A taxonomy, 2017.

T. D. Kulkarni, W. F. Whitney, P. Kohli, and J. Tenenbaum, Deep Convolutional Inverse Graphics Network, Advances in Neural Information Processing Systems (NIPS), p.84, 2015.

S. Laine and T. Aila, Temporal Ensembling for Semi-Supervised Learning, International Conference on Learning Representations (ICLR, 2017.

G. Lample, M. Ott, A. Conneau, L. Denoyer, and M. Ranzato, Phrase-Based & Neural Unsupervised Machine Translation, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, vol.84, p.91, 2018.

H. Larochelle and Y. Bengio, Classification using discriminative restricted Boltzmann machines, Proceedings of the 25th international conference on Machine learning - ICML '08, 2008.

L. Le, A. Patterson, and M. White, Generalization Performance of Some Learning Problems in Hubert Functional Spaces, Advances in Neural Information Processing Systems 14, vol.46, 2002.

Y. Lecun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard et al., Backpropagation Applied to Handwritten Zip Code Recognition, Neural Computation, vol.1, issue.4, pp.541-551, 1989.

Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, Gradient-based learning applied to document recognition, Proceedings of the IEEE, vol.86, issue.11, pp.2278-2324, 1998.

Y. Lecun, . Fu-jie-huang, and L. Bottou, Learning methods for generic object recognition with invariance to pose and lighting, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., p.93

C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Cunningham et al., Photo-realistic single image super-resolution using a generative adversarial network, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (cit, p.81, 2017.

D. Lee, Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks, International Conference on Machine Learning Workshop (ICML-W) (cit, p.24, 2013.

L. Ba, J. , J. R. Kiros, and G. Hinton, Preprint repository arXiv achieves milestone million uploads, Physics Today, p.22, 2014.

P. Liu and H. Li, Efficient Learning Algorithms for Three-Layer Regular Feedforward Fuzzy Neural Networks, IEEE Transactions on Neural Networks, vol.15, issue.3, pp.545-558, 2004.

Y. Liu, Z. Wang, H. Jin, and I. Wassell, Multi-task Adversarial Network for Disentangled Feature Learning, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, vol.27, p.91, 2018.

Y. Liu, F. Wei, J. Shao, L. Sheng, J. Yan et al., Exploring Disentangled Feature Representation Beyond Face Identification, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, vol.84, 2018.

Z. Liu, P. Luo, X. Wang, and X. Tang, Deep Learning Face Attributes in the Wild, 2015 IEEE International Conference on Computer Vision (ICCV), p.92, 2015.

C. Louizos, K. Swersky, Y. Li, M. Welling, and R. Zemel, The variational fair autoencoder, International Conference on Learning Representations (ICLR) (cit, p.77, 2016.

Z. Lu, H. Pu, F. Wang, Z. Hu, and L. Wang, The expressive power of neural networks: A view from the width, Advances in Neural Information Processing Systems (NIPS) (cit. on p, vol.18, 2017.

T. Lucas, K. Shmelkov, K. Alahari, C. Schmid, and J. Verbeek, Adversarial training of partially invertible variational autoencoders, 2019.

W. Luo, Y. Li, R. Urtasun, and R. Zemel, Understanding the effective receptive field in deep convolutional neural networks, Advances in Neural Information Processing Systems (NIPS) (cit, p.16, 2016.

D. C. Luvizon, H. Tabia, and D. Picard, Human pose regression by combining indirect part detection and contextual information, Computers & Graphics, vol.85, pp.15-22, 2019.
URL : https://hal.archives-ouvertes.fr/hal-02314445

A. Makhzani, J. Shlens, N. Jaitly, and I. Goodfellow, Adversarial Autoencoders, International Conference on Learning Representations (ICLR) (cit, p.82, 2016.

S. Mallat, Group Invariant Scattering, Communications on Pure and Applied Mathematics, vol.65, issue.10, pp.1331-1398, 2012.

S. Mallat and G. Peyré, A wavelet tour of signal processing : the sparse way, p.52, 2009.

M. F. Mathieu, J. J. Zhao, J. Zhao, A. Ramesh, P. Sprechmann et al., Disentangling factors of variation in deep representation using adversarial training, Advances in Neural Information Processing Systems (NIPS) (cit. on pp. 7, 27, vol.77, 2016.

W. S. Mcculloch and W. Pitts, A logical calculus of the ideas immanent in nervous activity, The Bulletin of Mathematical Biophysics, vol.5, issue.4, pp.115-133, 1943.

E. Mehr, A. Lieutier, F. S. Bermudez, V. Guitteny, N. Thome et al., Manifold Learning in Quotient Spaces, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018.

T. Miyato, S. Maeda, M. Koyama, and S. Ishii, Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.41, issue.8, pp.1979-1993, 2019.

A. Neelakantan, L. Vilnis, V. Quoc, I. Le, L. Sutskever et al., Invariant Representations: Mathematics of Invariance, Visual Cortex and Deep Networks, p.20, 2016.

Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu et al., Reading digits in natural images with unsupervised feature learning, Advances in Neural Information Processing Systems Workshop (NIPS-W) (cit, p.60, 2011.

H. Noh, T. You, J. Mun, and B. Han, Greedy Layer-Wise Training of Deep Networks, Advances in Neural Information Processing Systems 19, p.20, 2007.

D. Noyes, How Valuable is Integrity for Mid- and Top-Level Executives?, 2014.

C. Nwankpa, S. Eze, W. Ijomah, A. Gachagan, and S. Marshall, Achieving remanufacturing inspection using deep learning, Journal of Remanufacturing, p.15, 2020.

C. Olah, A. Mordvintsev, and L. Schubert, Feature Visualization, Distill, vol.2, issue.11, 2017.

A. Oliver, A. Odena, C. A. Raffel, E. Dogus-cubuk, and I. Goodfellow, Hyperparameter Learning for Graph Based Semi-supervised Learning Algorithms, Advances in Neural Information Processing Systems 19, p.97, 2007.

L. Paninski, Estimation of Entropy and Mutual Information, Neural Computation, vol.15, issue.6, pp.1191-1253, 2003.

M. Paumard, D. Picard, and H. Tabia, Jigsaw Puzzle Solving Using Local Feature Co-Occurrences in Deep Neural Networks, 2018 25th IEEE International Conference on Image Processing (ICIP), p.53, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01820489

X. Peng, X. Yu, K. Sohn, D. N. Metaxas, and M. Chandraker, Reconstruction-Based Disentanglement for Pose-Invariant Face Recognition, 2017 IEEE International Conference on Computer Vision (ICCV), vol.84, p.27, 2017.

G. Perarnau, J. Van-de, B. Weijer, J. M. Raducanu, and . Álvarez, Conditional mean field, Advances in Neural Information Processing Systems 19, vol.77, p.91, 2007.

G. Pereyra, G. Tucker, J. Chorowski, L. Kaiser, and G. Hinton, Regularizing Neural Networks by Penalizing Confident Output Distributions, International Conference on Learning Representations Workshop (ICLR-W) (cit, p.23, 2017.

D. C. Plaut and G. E. Hinton, Learning sets of filters using back-propagation, Computer Speech & Language, vol.2, issue.1, pp.35-61, 1987.

M. '. Ranzato, Y. Aurelio, Y. L. Boureau, and . Cun, Sparse Feature Learning for Deep Belief Networks, Advances in Neural Information Processing Systems (NIPS) (cit, p.25, 2008.

M. Ranzato, F. J. Huang, Y. Boureau, and Y. Lecun, Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition, 2007 IEEE Conference on Computer Vision and Pattern Recognition, p.49, 2007.

M. '. Ranzato, C. Aurelio, S. Poultney, Y. Chopra, and . Lecun, Efficient Learning of Sparse Representations with an Energy-Based Model, Advances in Neural Information Processing Systems 19, p.25, 2007.

M. A. Ranzato and M. Szummer, Semi-supervised learning of compact document representations with deep networks, Proceedings of the 25th international conference on Machine learning - ICML '08, 2008.

A. Rasmus, M. Berglund, M. Honkala, H. Valpola, and T. Raiko, Hyperparameter Learning for Graph Based Semi-supervised Learning Algorithms, Advances in Neural Information Processing Systems 19, vol.46, p.71, 2007.

S. Ren, K. He, R. Girshick, and J. Sun, Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.39, issue.6, pp.1137-1149, 2017.

S. Rifai, G. Mesnil, P. Vincent, X. Muller, Y. Bengio et al., Higher Order Contractive Auto-Encoder, Machine Learning and Knowledge Discovery in Databases, pp.645-660, 2011.

T. Robert, N. Thome, and M. Cord, HybridNet: Classification and Reconstruction Cooperation for Semi-supervised Learning, Computer Vision ? ECCV 2018, vol.157, pp.158-175, 2018.
URL : https://hal.archives-ouvertes.fr/hal-02073640

T. Robert, N. Thome, and M. Cord, DualDis: Dual-Branch Disentangling with Adversarial Learning, Under Review at Advances in Neural Information Processing Systems (NeurIPS) (cit. on, vol.75, p.9, 2019.

M. Rosca, B. Lakshminarayanan, D. Warde-farley, and S. Mohamed, Variational approaches for auto-encoding generative adversarial networks, p.82, 2017.

K. Roth, A. Lucchi, S. Nowozin, and T. Hofmann, Stabilizing training of generative adversarial networks through regularization, Advances in Neural Information Processing Systems (NIPS) (cit, p.81, 2017.

A. Ruiz, O. Martinez, X. Binefa, and J. Verbeek, Preprint repository arXiv achieves milestone million uploads, Physics Today, p.77, 2014.

D. E. Rumelhart, G. E. Hinton, and R. J. Williams, Learning representations by back-propagating errors, Nature, vol.323, issue.6088, pp.533-536, 1986.

O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh et al., ImageNet Large Scale Visual Recognition Challenge, International Journal of Computer Vision, vol.115, issue.3, pp.211-252, 2015.

M. Sajjadi, M. Javanmardi, and T. Tasdizen, Mutual exclusivity loss for semi-supervised deep learning, 2016 IEEE International Conference on Image Processing (ICIP), 2016.

T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford et al., Improved Techniques for Training GANs, Advances in Neural Information Processing Systems (NIPS), 2016.

S. Santurkar, D. Tsipras, A. Ilyas, and A. Madry, How does batch normalization help optimization?, In: Advances in Neural Information Processing Systems (NeurIPS), 2018.

I. Seck, G. Loosli, and S. Canu, L1-norm double backpropagation adversarial defense, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), p.22, 2019.
URL : https://hal.archives-ouvertes.fr/hal-02049020

O. Shamir, S. Sabato, and N. Tishby, Learning and generalization with the information bottleneck, Theoretical Computer Science, vol.411, issue.29-30, pp.2696-2711, 2010.

W. Shi, Y. Gong, C. Ding, Z. Ma, X. Tao et al., Transductive Semi-Supervised Deep Learning Using Min-Max Features, Computer Vision ? ECCV 2018, pp.311-327, 2018.

Z. Shu, M. Sahasrabudhe, R. Alp-güler, D. Samaras, N. Paragios et al., Deforming Autoencoders: Unsupervised Disentangling of Shape and Appearance, Computer Vision ? ECCV 2018, pp.664-680, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01935596

Z. Shu, E. Yumer, S. Hadap, K. Sunkavalli, E. Shechtman et al., Neural Face Editing with Intrinsic Image Disentangling, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), p.54, 2017.

P. Y. Simard, D. Steinkraus, and J. C. Platt, Best practices for convolutional neural networks applied to visual document analysis, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings., p.20

K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, International Conference on Learning Representations (ICLR) (cit. on pp, vol.23, pp.15-18, 2015.

J. Sokolic, R. Giryes, G. Sapiro, and M. R. Rodrigues, Robust Large Margin Deep Neural Networks, IEEE Transactions on Signal Processing, vol.65, issue.16, pp.4265-4280, 2017.

J. Springenberg and . Tobias, Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks, International Conference on Learning Representations (ICLR, 2016.

N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, Dropout: A Simple Way to Prevent Neural Networks from Overfitting, Journal of Machine Learning Research, 2014.

W. Sweldens, <title>Lifting scheme: a new philosophy in biorthogonal wavelet constructions</title>, Wavelet Applications in Signal and Image Processing III, p.50, 1995.

C. Szegedy, . Wei-liu, . Yangqing-jia, P. Sermanet, S. Reed et al., Going deeper with convolutions, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol.18, p.17, 2015.

C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, Rethinking the Inception Architecture for Computer Vision, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol.20, p.17, 2016.

A. Tarvainen and H. Valpola, Hyperparameter Learning for Graph Based Semi-supervised Learning Algorithms, Advances in Neural Information Processing Systems 19, vol.45, pp.140-142, 2007.

N. Tishby, F. C. Pereira, and W. Bialek, The information bottleneck method, Annual Allerton Conference on Communication, Control and Computing, 1999.

N. Tishby and N. Zaslavsky, Deep learning and the information bottleneck principle, 2015 IEEE Information Theory Workshop (ITW), vol.128, p.31, 2015.

L. Tran, X. Yin, and X. Liu, Disentangled Representation Learning GAN for Pose-Invariant Face Recognition, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), p.84, 2017.

J. Turian, L. Ratinov, and Y. Bengio, Word representations: a simple and general method for semi-supervised learning, Proceedings of the 48th annual meeting of the association for computational linguistics, 2010.

D. Ulyanov, A. Vedaldi, and V. Lempitsky, Improved Texture Networks: Maximizing Quality and Diversity in Feed-Forward Stylization and Texture Synthesis, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), p.22, 2017.

V. N. Vapnik, The Vicinal Risk Minimization Principle and the SVMs, The Nature of Statistical Learning Theory, vol.18, pp.267-290, 2000.

V. N. Vapnik and A. Y. Chervonenkis, On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities, Measures of Complexity, pp.11-30, 2015.

P. Vincent, H. Larochelle, Y. Bengio, and P. Manzagol, Extracting and composing robust features with denoising autoencoders, Proceedings of the 25th international conference on Machine learning - ICML '08, p.25, 2008.

L. Wan, M. Zeiler, S. Zhang, Y. Le-cun, and R. Fergus, Regularization of Neural Networks using DropConnect, International Conference on Machine Learning (ICML), 2013.

T. Wang, M. Liu, J. Zhu, A. Tao, J. Kautz et al., High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, p.82, 2018.

J. Weston, F. Ratle, and R. Collobert, Deep learning via semi-supervised embedding, Proceedings of the 25th international conference on Machine learning - ICML '08, 2008.

Z. Wojna, J. Uijlings, S. Guadarrama, N. Silberman, L. Chen et al., The Devil is in the Decoder, Procedings of the British Machine Vision Conference 2017, p.50, 2017.

Y. Wu and K. He, Group Normalization, Computer Vision ? ECCV 2018, pp.3-19, 2018.

S. Zagoruyko and N. Komodakis, Wide Residual Networks, Procedings of the British Machine Vision Conference 2016, p.36, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01832503

M. D. Zeiler and R. Fergus, Visualizing and Understanding Convolutional Networks, Computer Vision ? ECCV 2014, pp.818-833, 2014.

C. Zhang, S. Bengio, M. Hardt, B. Recht, and O. Vinyals, Understanding deep learning requires rethinking generalization, International Conference on Learning Representations (ICLR, vol.37, 2017.

H. Zhang, T. Yann-n-dauphin, and . Ma, International Conference on Learning Representations (ICLR) (cit. on p. 5), 2019.

Y. Zhang, K. Lee, and H. Lee, Augmenting Supervised Neural Networks with Unsupervised Objectives for Large-scale Image Classification, International Conference on Machine Learning (ICML) (cit. on pp. 23, vol.46, p.55, 2016.

J. Zhao, M. Mathieu, R. Goroshin, and Y. Lecun, Stacked What-Where Auto-encoders, International Conference on Learning Representations Workshop (ICLR-W) (cit. on pp, vol.53, p.66, 2016.

J. Zhu, T. Park, P. Isola, and A. A. Efros, Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks, 2017 IEEE International Conference on Computer Vision (ICCV), p.81, 2017.

L. Zhu, R. Deng, M. Maire, Z. Deng, G. Mori et al., Sparsely Aggregated Convolutional Networks, Computer Vision ? ECCV 2018, pp.192-208, 2018.

X. Zhu, Semi-Supervised Learning Literature Survey, p.24, 2005.

X. Zhu and T. T. Rogers, A Cognitive Study of Learning with Labeled and Unlabeled Data, p.24, 2012.